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DESCRIPTION 

METHOD AND SYSTEM FOR MEASURING THE 
. CONCENTRATIONS OF FLUORESCENT DYES 
Technical Field 

5 [0001] The present invention relates to measurement of the 
. concentrations of fluorescent dyes contained in a sample. 
Background Art 

[0002] A method of measuring the concentration of a fluorescent dye 
contained in a sample is described in Gary R. Bright, "Multiparameter 

10 Imaging of Cellular Function" on pp204-215 in "Fluorescent and 
Luminescent Probes for Biological Activity" edited by W. T. Mason, 
1993, Academic Press, USA. This method is to extract a wavelength 
component necessary for excitation of a fluorescent dye, from white 
light by means of a dichroic filter and to illuminate a sample with the 

15 wavelength component to produce fluorescence. This fluorescence is 
detected through a band-pass filter and with a monochrome (black-and- 
white) camera, and the intensity thereof is measured. The band-pass 
filter is used for receiving only the wavelength component 
corresponding to the fluorescent dye in the sample, with the camera. 

20 Since the intensity of the fluorescence emitted from the fluorescent dye 
in the sample is proportional to a concentration of the fluorescent dye, 
the intensity of the fluorescence measured in this manner is handled as 
the concentration of the fluorescent dye, 

[0003] This method is implemented using a filter set consisting of the 
25 dichroic filter and the band-pass filter according to the fluorescent dye. 

As long as the sample contains only one kind of fluorescent dye, one 
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filter set can be fixedly used. However, if the sample contains two or 
more kinds of fluorescent dyes, a plurality of filter sets must be used as 
replaced one fi:om another during measurement of the sample. The 
replacement of filter set will cause a slight change in an optical system 
and thus affect the accuracy of the measurement. In addition, the 
replacement of filter set will produce a difference between measurement 
times of different fluorescent dyes. This is undesirable for 
measurement of a living sample. 

[0004] The above-described method also has a point to be improved in 
terms of the measurement accuracy. In a case where peak wavelengths 
of fluorescent dyes in a sample are located close to each other, wings of 
fluorescence spectra overlap with each other. In this case, it is 
infeasible to extract only a wavelength component corresponding to a 
single fluorescent dye fi-om the fluorescence spectra even with the use 
of the band-pass filter, and a wavelength component of another 
fluorescent dye shall be mixed in the fluorescence having passed 
through the filter. This degrades the accuracy of the measurement of 
the fluorescent dye. 
Disclosure of the invention 

[0005] An object of the present invention is to accurately measure the 
concentrations of a plurality of fluorescent dyes. 

[£J06] In one aspect, the present invention relates to a method of 
measuring the concentrations of fluorescent dyes in a sample. This 
method measures the concentrations of first to mth (where m is an 
integer of 2 or more) fluorescent dyes contained in a target sample, 
using an imaging device having first to kth (where k is an integer of 2 or 
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more) different detection wavelength bands. Portions of the detection 
wavelength bands overlap any adjacent bands. In this method, first to 
mth reference samples are prepared, each of which contains only one of 
the first to mth fluorescent dyes respectively at predetermined unit 
5 concentrations, and a measured intensity of fluorescence emitted jfrom 
each reference sample is acquired in each detection wavelength band. 
A fluorescence image of the target sample is taken in each detection 
wavelength band usmg the imaging device. Then an operation 
represented by a formula below is executed to calculate concentrations 
10 ci - Cm of the first to mth fluorescent dyes at a site in the target sample. 



[Formula 1] 
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In this formula, O] - 0^ represent the values of pixels in the 
fluorescence images of the target sample taken in the first to kth 

15 detection wavelength bands, and the pixels correspond to the site. J 
represents a k^m matrix, and a component Jjj in the ith row and jth 
column (where i is any integer from 1 to k, and j any integer from 1 to 
m) in J represents the measured intensity in the ith detection wavelength 
band of the fluorescence emitted from the jth reference sample. 

20 [0007] The above calculation fomiula is not affected by overlap 
between the fluorescence spectra of the fluorescent dyes contained in 
the target sample. Thus, by this measurement method, it is possible to 
accurately determine the concentrations of the fluorescent dyes h^^'i >2 
the overlapping fluorescence spectra. 
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[0008] The imaging device may include a multiband camera having the 
first to kth detection wavelength bands. The acquisition of the 
measured intensity of the fluorescence emitted from each reference 
sample in each detection wavelength band may include taking a 

5 fluorescence image of each reference sample in each detection 
wavelength band using the multiband camera and acquiring the value of 
a pixel representing a site emitting fluorescence in each reference 
sample, from each fluorescence image. The calculation of the 
concentrations Ci - c^ of the first to mth fluorescent dyes may use the 

10 value of the pixel acquired from the fluorescence image of the jth 
reference sample taken in the ith detection wavelength band as the 
component Jy in the matrix J. In this case, the fluorescence intensities 
of the reference samples and the target sample both can be measured 
using the same multiband camera. Consequently, the concentrations of 

15 the fluorescent dyes can be readily measured. 

[0009] The imaging device may include a multiband camera having the 
first to kth detection wavelength bands. The acquisition of the 
measured intensity of the fluorescence emitted from each reference 
sample in each detection wavelength band may include measuring the 

20 spectral intensities of the fluorescence emitted from each reference 
sample using a spectrometer, and calculating a measured intensity in 
each detection wavelength band of the fluorescence emitted from each 
reference sample using the spectral intensities and the sensitivity 
characteristic of the multiband camera for each detection wavelength 

25 band. In this manner, the measured intensity of the fluorescence 
emitted from each reference sample in each detection wavelength band 
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can also be acquired using the spectrometer, instead of the direct 
acquisition using the imaging device. 

[0010] In another aspect, the present invention relates to a method of 
measuring the concentrations of first to mth (where m is an integer of 2 
or more) fluorescent dyes contained in a target sample, using an 
imaging device. The imaging device has first to kth (where k is an 
integer of 2 or more) different detection wavelength bands, and first to 
qth (where q is an integer of 2 or more) sensitivity modes for setting 
different sensitivity characteristics of the imaging device. Portions of 
the detection wavelength bands overlap any adjacent bands. In this 
method, first to mth reference samples are prepared, each of which 
contains only one of the first to mth fluorescent dyes respectively at 
predetermined unit concentrations, and a measured intensity of. 
fluorescence emitted fi-om each reference sample is acquired in each 
detection wavelength band and in each sensitivity mode. a 
fluorescence image of the target sample is taken in each detection 
wavelength band and in each sensitivity mode using the imaging device. 
Then, an operation represented by a formula below is executed to 
calculate concentrations Ci - Cn, of the first to mth fluorescent dyes at a 
site in the target sample. 
[Formula 2] 
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In this formula, Pv (where v is any integer from 1 to q) represents a kxl 
matrix, and a component Pjv (where i is any integer from 1 to k) in the 
ith row in Py represents the value of a pixel in the fluorescence image of 
5 the target sample taken in the ith detection wavelength band and in the 
vth sensitivity mode using the imaging device, and the pixel 
corresponds to the site. Ji represents a (k-q)xm matrix, and a 
coinponent L,yj in the ith row in a component matrix Lyj (where j is any 
integer from 1 to m) in Ji represents the measured intensity of the 

10 fluorescence emitted from the jth reference sample in the ith detection 
wavelength band and in the vth sensitivity mode. 
[0011] The above calculation formula is not affected by overlap 
between the fluorescence spectra of the plurality of fluorescent dyes 
contained in the target sample. Thus, by this measurement method, it 

15 is possible to accurately determine the concentrations of the f(T?orescent 

dyes having the overlapping fluorescence spectra. The number of 
fluorescent dyes that can be measured by this method is equal to (liie 
number of detection wavelength bands) x (the number of sensitivit}' 
modes). Tlierefore. it is possible to increase the number of fluorcsccL-: 

20 dyes that can be measured, according to the number of sensitivit}' 
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modes. 

[0012] In still another aspect, the present invention relates to a method 
of measuring the concentrations of first.to mth (where m is an integer of 
2 or more) fluorescent dyes contained in a target sample, using an 
imaging device having first to kth (where k is an integer of 2 or more) 
different detection wavelength bands. Portions of the detection 
wavelength bands overlap any adjacent bands. In this method, first to 
mth reference samples are prepared, each of which contains only one of 
the first to mth fluorescent dyes respectively at predetermined unit 
concentrations, the first to mth reference samples are illuminated with 
each of first to rth (where r is an integer of 2 or more) excitation beams 
having different wavelength spectra for exciting all the first to mtii 
fluorescent dyes, and a measured intensity of fluorescence emitted fi-om 
each reference sample is acquired in each detection wavelength band. 
The target sample is illuminated with each excitation beam and a 
fluorescence image of the target sample is taken in each detection 
wavelength band using the imaging device. Then, an operation 
represented by a formula below is executed to calculate the 
concentrations Ci - Cn, of the first to mth fluorescent dyes at a site, in the 
target sample. 
[Formula 3] 
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In this formula, Qu (where u is any integer from 1 to r) represents a k^l 
matrix, and a component Qiu in the ith row (where i is any integer from 
1 to k) in Qu represents the value of a pixel in the fluorescence image of 

5 the target sample taken in the ith detection wavelength band upon 
illuminating the target sample with the uth excitation beam, and the 
pixel corresponds to the site. J2 represents a (k r)xm matrix, and a 
component Tjuj in the ith row of a component matrix T„j (where j is any 
integer from 1 to m) in J2 represents the measured intensity of the 

10 fluorescence emitted from the jth reference sample in the ith detection 
wavelength band upon illuminating the jth reference sample with the uih 
excitation beam. 

[0013] The above-described calculation formula is not affected by 
overlap between the fluorescence spectra of the plurality of fluorescent 
15 dyes contained in the target sample. Thus, by this measurement 

method, it is possible to accurately determine the concentrations 01 i^e 
fluorescent dyes having the overlapping fluorescence specti-a. ine 
number of fluorescent dyes that can be measured by this method is 
equal to (the number of detection wavelength band) x (the number of 
20 types of excitation beams). Therefore, it is possible to increase ihe 
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number of fluorescent dyes that can be measured., according to the 
number of types of excitation beams. 

[0014] In these measurement methods of thn n:e??r.t inv.^ntion. the 
imaging device may include one or more ini3gi5ig d-^vircs for t?!-:ing 
hrr^.^^ of the target sample in 'hf, nrr' to I dr-te-::-- :: 
v;',.v.- '.f.n;; : b-.-cs ^.-:.;:ri':-. first to kCn in: ig.: sigi::Ii, c.r. ' 
arithmetic circuit to which the first to kth unage signals are fed. The 
calculation of the concentrations Cj - 0^ of the first to mth fluorescent 
dyes may include a process in which the arithmetic circuit executes the 
operation using the first to kth image signals. These measurement 
methods may further include causing the arithmetic circuit to calculate 
the concentrations Ci - Cm at a plurality of sites in the target sample, and 
to generate first to mth image signals indicating the concentration 
distributions of the first to mth fluorescent dyes. In these measurement 
methods, the imaging device calculates the concentrations of the 
fluorescent dyes, using the fluorescence image signals of the target 
sample acquired by itself, and generates the image signals indicating the 
concentration distributions. Therefore, these measurement methods 
are able to quickly present the measurement results. 
[0015J In another aspect, the present mvention relates to a system for 
measuring the concenu i i'cijs of first tc z,di (where m is ai hv-cger 
or more) fluorescent dyes contained in a target sample. This system 
comprises a photodetector, an imaging device, and an arithmetic device. 
The photodetector detects fluorescence emitted firom each of first to mth 
reference samples each containing only one of the first to mth 
fluorescent dyes respectively in predetermined unit concentrations, and 
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measures the intensity of the fluorescence. The imaging device has 
first to kth (where k is an integer of 2 or more) different detection 
wavelength bands, and takes a fluorescence image of the target sample 
in each detection wavelength band. Portions of the detection 
wavelength bands overlap any adjacent bands. VuZ : . - ic d-rW:-- 
executes an operation represented by a fomiuk=^ bv'ow, l^ulate tlv 
concentrations Ci - Cm of the first to mth fluorescent dyes at a site in the 
target sample. 



[Formula 4] 
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In this formula, Oi - Ok represent the values of pixels in the 
fluorescence images of the target sample taken in the first to kth 
detection wavelength bands, and these pixels correspond to the site. J 
represents a kxm matrix, and a component Jy in tiie ith row and jth 
colunrn (where i is any integer from 1 to k, and j any integer from 1 to 
m) in J represents the intensity of the fluorescence emitted from the jth 
reference sample in the ith detection wavelength band, measured by the 
photodetector. 

[C016J The above-described calculation formula is n-t ejected b)^ 
overlap between the fluorescence spectra of the plurality of fluorescent 
dyes contained in the target sample. Thus, this measurement system is 
able to accurately determine the concentrations of the fluorescent dyes 
having the overlapping fluorescence spectra. 

[0017] A multiband camera having the first to kth (where k is an integer 
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of 2 or more) detection wavelength bands may be used as the 
photodetector and the imaging device. The photodetector may be 
configured to take a fluorescence image of each reference ssmpie in 
each detection v/avelength band and to acquire the value of a pixel 
rep.-:-i-V;'i..'JS a site emitting fluorescence in each reference sample, from 
each fluorescence image. The arithmetic device may use the value of 
the pixel acquired from the fluorescence image of the jth reference 
sample taken in the ith detection wavelength band as the component Jy 
in the matrix J. In this case, the fluorescence intensities of both the 
reference samples and the target sample can be measured with using 
same multiband camera. Therefore, the concentrations of the 
fluorescent dyes can be readily measured, 

[0018] The photodetector may include a spectrometer for measuring 
spectral intensities of the fluorescence emitted from each reference 
sample. The imaging device may include a multiband camera having 
the first to kth detection wavelength bands. The arithmetic device may 
be configured to calculate the intensity of the fluorescence emitted from 
each reference sample in each detection wavelength band, using the 
spectral intensities measured by the spectrometer and a sensitivity 
characteristic of the multiband camera for each detection wavelength 
band, and to use the calculated intensities as components of the matrix 
J. Thus, the measured intensity in each detection wavelength band of 
the fluorescence emitted from each reference sample can also be 
acquired using the spectrometer, instead of the direct acquisition using 
the imaging device, 

[0019] In still another aspect, the present invention relates to a system 
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for measuring the concentrations of first to mth (where m is an integer 
of 2 or more) fluorescent dyes contained in a target sample. This 
system comprises a pbor jdelector, an imaging device, and an arithmetic 
device. The photodetector detects fluorescence emitted from each of 

5 Hrzt to mth. xcferen^^ s -^r.ples each containij?^ cnly one of l1:c nrst to 

mth fluorescent dyes respectively at predetermined unit concentrations, 
and measures the intensity of the fluorescence. The imaging device 
has first to kth (where k is an integer of 2 or more) different detection 
wavelength bands, and first to qth (q is an integer of 2 or more) 

10 sensitivity modes for setting different sensitivity characteristics of the 

imaging device. Portions of the detection wavelength bands overlap 
any adjacent bands. This imaging device takes a fluorescence image 
of the target sample in each detection wavelength band and in each 
sensitivity characteristic. The arithmetic device executes an operation 

15 ^represented by a formula below, to calculate concentrations Ci - Cm of 
the first to mth fluorescent dyes at a site in the target sample. 



[Formula 5] 
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In this formula, Pv (where v is any integer i&om 1 to q) represents a kx 1 
20 matrix, and a component Pjv in the ith row (where i is any integer from 1 
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to k) in Pv represents the value of a pixel in the fluorescence image of 
the target sample taken in the ith detection wavelength band and in the 
vth sensitivity mode, and the pixel coiresponds to the site. Ji 
represents a (k-q)xm matrix, and a component Ljvj in the itli rowin a 
component matrix Lvj (where j is any integer jfrom 1 to )ti) in Jj 
represents tlie measured intensity in the ith detection wavelc- '^rth band 
and in the vth sensitivity mode of the fluorescence emitted from the jth 
reference sample. 

[0020] The above-described calculation formula is not affected by 
overlap between the fluorescence spectra of the plurality of fluorescent 
dyes contained in the target sample. Thus, this measurement system is 
able to accurately determine the concentrations of the fluorescent dyes 
having the overlapping fluorescence spectra. The number of 
fluorescent dyes that can be measured by this system is equal to (the 
number of detection wavelength bands) x (the number of sensitivity 
modes). Therefore, it is possible to increase the number of fluorescent 
dyes that can be measured, according to the number of sensitivity 
modes. 

[0021] In still another aspect, the present invention relates to a system 
for measuring the concentrations of first to mth (where m is an integer 
of 2 or more) fluorescent dyes contained in a target sample. This 
system comprises a light source, a photodetector, an imaging device, 
and an arithmetic device. The light source generates first to rth (where 
r is an integer of 2 or more) excitation beams having different 
wavelength spectra for exciting all the first to mth fluorescent dyes. 
The photodetector measures the intensity of fluorescence emitted from 
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each of first to mth reference samples upon illuminating each reference 
sample with each excitation beam, each reference sample containing 
only one of the fu-st to mth fluorescent dyes respectively at 
predetermined unit concentrations. The imaging device has first to kth 
(where k is an integer of 2 or more) different detection wavelengtli 
bands. Portions of the detection wavelength bands overlap any 
adjacent bands. The imaging device takes a fluorescence image of the 
target sample in each detection wavelength band upon illuminating the 
target sample with each excitation beam. The arithmetic device 
executes an operation represented by a formula below, to calculate 
concentrations Ci - Cn, of the first to mth fluorescent dyes at a site in the 
target sample. 
. [Formula 6] 
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In this formula, Qu (where u is any integer from 1 to r) represents a kxl 
matrix, and a component Qiu in the ith row (where i is any integer from 
1 to k) in Qu represents the value of a pixel in the fluorescence image of 
the target sample taken in the ith detection wavelength band upon 
illuminating the target sample with the uth excitation beam, and the 
pixel corresponds to the site. J2 represents a (k r)xm matrix, and a 



T.= 



^ Ivj 

T 

^ 2uj 



^kvj 



- 14- 



FP04-.031S-OOUS-HP 



component Tjuj in the ith row in a component matrix T^j (where j is any 
integer from 1 to m) in J2 represents the measured intensity of the 
flu.orescence in the ith detection wavelength band uprn :?;\^minatinr, th::: 
jth reference sample with the irJ r excitation beam. 
[0C22] The above-d-^rcnbed r..'.lculation fc:/::^"^ pf%-" b/ 

overlap between tlie fluorescence spectra of tijc y}: -i '.';;* of fiuc:*"scer«'. 
dyes contained in the target sample. Thus, this measurement system is 
able to accurately determine the concentrations of the fluorescent dyes 
having the overlapping fluorescence spectra. The number of 
fluorescent dyes that can be measured by this system is equal to (the 
number of detection wavelength bands) x (the number of types of 
excitation beams). Therefore, it is possible to increase the number of 
fluorescent dyes that can be measured, according to the number of types 
of excitation beams. 

[0023] In the measurement system of the present invention, the imaging 
device may include one or more imaging devices for taking the 
fluorescence images of the target sample in the first to kth detection 
wavelength bands to generate first to kth image signals, and an 
arithmetic circuit as the aforementioned arithmetic device. The first to 
kth image signals are fed to this arithmetic circuit. The arithmetic 
circuit may be configured to execute the operate : '-'^Ti^r the first to kt-: 
image signals, to calculate the concentrations Ci - c^ at a plurality of 
sites of the target sample, and to generate first to mth image signals 
indicating the concentration distributions of the first to mth fluorescent 
dyes. In this measurement system, the imaging device calculates the 
concentrations of the fluorescent dyes, using the fluorescence image 
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signals of the target sample acquired by itself, and generates the image 
signals indicating the concentration distributions. Consequently, this 
measurement system is able to quickly present the measurement results. 
Brief Description of the Drawings 
5 [0024] Fig. 1 is a block diagram showng a configuration of an example 

of a fluorescent dye measurement system. 

Fig. 2 is a flowchart showing a procedure of measuring the 
concentrations of fluorescent dyes. 

Fig. 3 is an illustration for explaining the second stage of 
10 measurement. 

Fig. 4 is an illustration to illustrate an example of an expression 
method of measurement results. 

Fig. 5 is an illustration to illustrate an example of an expression 
method of measurement results. 
15 Fig. 6 is an illustration to illustrate an example of an expression 

method of measurement results. 

Fig. 7 is a block diagram showing a configuration of another 
example of a fluorescent dye measurement system. 

Fig. 8 is a diagram showing a relation between the 
20 concentrations of CA'^^ and fluorescence intensity ratios. 

Fig. 9 is a diagram showing sensitivit}^ cLaracterisucs of a 3- 
band camera. 

Fig. 10 is a diagram showing spectral data acquired from target 
samples in which Alexa Fluor and Cascade Yellow are mixed. 
25 Fig. 11 is a diagram showing spectral data acquired from target 

samples in which Fura2 and Cascade Yellow are mixed. 
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Fig. 12 is a diagram showing spectral data measured through a 
band-pass filter from target samples in which Alexa Fluor and Cascade 
Yciiow are mixed. 

Fig. 13 is a diagi-am showing spectral data acquired through a 
bavi J-pass filter from target samples in which Fura2 and Cascade Yellow 
are mixed. 

Fig. 14 is a diagram showing the concentrations of Alexa Fluor 
and Cascade Yellow calculated in first and second examples. 

Fig. 15 is a diagram showing the concentrations of Alexa Fluor 
and Cascade Yellow calculated in a third example and a comparative 
example. 

Fig. 16 is a diagram showing the concentrations of Fura2 and 
Cascade Yellow calculated in the first and second examples. 

Fig. 17 is a diagram showing the concentrations of Fura2 and 
Cascade Yellow calculated in the third example and the comparative 
example. 

Fig. 18 is a diagram showing actually measured fluorescence 
spectra of reference samples and a target sample. 

Fig. 19 is a diagram showing a fluorescence spectrum of a target 
sample calculated using the concentrations of fluorescent dyes obtained 
in the first example. 

Fig. 20 is a diagram showing a fluorescence spectrum of a target 
sample calculated using the concentrations of fluorescent dyes obtained 
in the second example. 

Fig. 21 is a block diagram showing a configuration of another 
example of a fluorescent dye measurement system. 
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Fig. 22 is a diagram showing various data concerning 
measurement of fluorescent dyes. 

Fig. 23 is a block diagram shov/ing an electronx circuit 
mounted on a multiband camera. 
5 Fig. 24 is photographs showing images acquired in the eighth 

embodiment. 

Fig. 25 is photographs showing images, acquired in a 
comparative example. 

Fig, 26 is a diagram showing sensitivity characteristics of a 4- 
10 band camera. 

Best Mode for Carrying out the Invention 

[0025] Embodiments of the present invention will be described below 
in detail with reference to the accompanying drawings. In the 
description of the drawings the same elements will be denoted by the 

1 5 same reference symbols, without redundant description. 

[0026] First Embodiment 

Fig. 1 is a block diagram showing a configuration of a 
fluorescent dye measurement system of the present embodiment. The 
measurement system 100 has a ligiit source 10, a fluorescence 

20 microscope 20, a multiband camera 30, and a personal computer 40. A 
display device 42 and a printer A A are co: :riected to the computer 40. 
The measurement system 100 measures the concentrations of 
fluorescent dyes contained in a target sample. The measurement 
system 100 can measure the concentrations of three or less typeis of 

25 • fluorescent dyes. It is assumed in the present embodiment that t>^pes 
of fluorescent dyes contained in the target sample are preliminarily 
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known. 

[0027] The light source 10 generates light for exciting a sample 1 and 
illuminates the sample 1 with the light The lipht source 10 h^s a Xe 
lamp 10a and a multicolor emission type LED 10b, one of which is 
selectively used. The computer 40 controls which is to be used out of 
the Xe lamp 10a and LED 10b. The Xe lamp 10a is used in the present 
embodiment. 

[0028] The fluorescence microscope 20 acquires an optical image of 
fluorescence emitted from the sample 1 under irradiation with the light 
from the light source 10, at a predetermined magnification, and feeds 
the image to the multiband camera 30. The fluorescence microscope 
20 has a band-pass filter 22 for receiving the light from the fight source 
10, and a band-pass filter 24 for receiving the fluorescence emitted from 
the sample 1 . The band-pass filter 22 is used for removing wavelength 
components unnecessary for excitation of a fluorescent dye contained in 
the sample 1, from the light of the fight source 10. The band-pass filter 
24 is used for interrupting light of wavelengths different from the 
fluorescence emitted from the fluorescent dye contained in the sample 
1 . The pair of these filters 22 and 24 are sometimes called a filter set. 
[0029] The multiband camera 30 is an imaging device for receiving the 
optical image of fluorescence from the fluorescence rr-icr.>.. , 20 to 
generate electric image data thereof. In the present embodiment the 
multiband camera 30 has three different detection wavelength bands and 
is sensitive to these detection wavelength bands. These detection 
wavelength bands normally correspond to R (red), G (green), and B 
(blue). In the description hereinafter, these detection wavelength 



- 19- 



FP04-0318-C 



bands will be referred to as the R wavelength band, the G wavelength 
band, and the B wavelength band. Portions of the detection 
waveli-ngth bands overlap any adjacent bands. Namely, the R 
wavelength band and tlie G wavelengtli band overlap in part, aiid the G 

5 wavelengtli band and the B vravelength band also overlap in part. Tb^ 

multiband camera 30 includes three imaging devices (e.g., CCDs) 
corresponding to these detection wavelength bands, and a color 
separation prism for separating wavelength components of input light 
into the three detection wavelength bands and for feeding them to the 

10 corresponding imaging devices. In addition, the multiband camera 30 
may include one imaging device (e.g., CCD) on which a color mosaic 
filter or the like is printed. The multiband camera 30 detects 
fluorescence images in the respective R, Q and B wavelength bands and 
generates R, Q and B outputs corresponding to those wavelength bands. 

15 The R, G, and B outputs are image data of the fluorescence images 

detected in the R, Q and B wavelength bands, respectively. The image 
data includes values indicating the intensities of fluorescence at 
respective pixels. Each pixel corresponds to one site in the sample 1 . 
[0030] As will be described later in detail, the multiband camera 30 has 

20 two operation modes. The fnrst one is a High Light mode having a 
standard sensitivity characteristic, and the second a Low L:::'t mcL 
having the total sensitivity a little higher tlian the standard sensitivity. 
In the present embodiment the camera 30 operates only in the High 
Light mode. 

25 [0031] The computer 40 is a device for controlling the measurement of 

fluorescent dyes by the measurement system 100. The computer 40 
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transmits a light-source switch signal to the light source 10 to control 
which is to be used out of the Xe lamp 10a and LED 10b. The 
computer 40 also iuiiciious as an arithiielic 6 jvicc: ior calculating the 
concenu-ations of respective tluore scent dye^ in a U-rget sample, using 
5 fluorescence imar,t data of the target san? nle acquired by the multiband 

camera 30. The computer 40 has a storage device for storing software 
for this control and operation. This software may be read from a 
storage medium 46 into the storage device. The computer 40 executes 
the foregoing control and operation according to this software. 

10 [0032] A method of measuring the concentrations of fluorescent dyes in 

a target sample with the measurement system 100 will be described 
below with reference to Fig. 2. Fig. 2 is a flowchart showing the 
procedure of the measurement This measurement method is roughly 
divided into two stages. The first stage corresponds to steps S202 and 

15 S204, and the second stage to steps S206 - S212. 

[0033] The first stage is to acquire data as a basis for the measurement. 
First, reference samples are prepared for acquiring this basic data (step 
S202). Each reference sample contains only one of the fluorescent 
dyes contained in the target sample respectively. Tnerefore, the 

20 reference samples are prepared as many as the fluorescent dyes in tlie 
target sample. Each reference sample contaii.r p. f uorcf^cot dye a-, a 
predetermined concentration. In the description hereinafter, this 
concentration will be referred to as a unit concentration. A unit 
concentration of a fluorescent dye in one reference sample may be 

25 different from that in another reference sample. 

[0034] The next step is to acquire fluorescence image data pf each 
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refr^rerce sf^mple with the measurement system 100 (step S204). 
Y.^iite lipht is emitted from the Xe lamp 10a and each reference sample 
is illuminated with tlie white light through the band-pass filter 22. 
Tins excites the fluorescent dye in the reference sample to generate 
fl^?orescence. The light having passed the band-pass filter 22 has a 
wavelength spectrum that can excite all the reference samples. 
[0035] The multiband camera 30 receives the fluorescence image of 
each reference sample through the fluorescence microscope 20 and 
converts it into image data. The fluorescence image is detected in each 
of the R, G, and B wavelength bands of the multiband camera 30. 
Therefore, the multiband camera 30 generates three image data acquired 
in the three detection wavelength bands, for one reference sample. 
The image data is fed to the computer 40 to be stored in the storage 
device in the computer 40. This is basic data acquired for one 
reference sample. The same measurement is carried out for all the 
reference samples and the basic data is stored. The first stage of the 
measurement is completed in this manner. 

[0036] Each pixel in each basic data has a value indicating a 
fluorescence intensity measured using the multiband camera 30. Pixel 
values acquired in the R, Q and B wavelength bands are sometimes 
called R values, G values, and B values, respectively. 
[0037] The second stage of the measurement will be described below 
wit reference to Fig. 3. The second stage is to calculate the 
concentrations of the respective fluorescent dyes in the target sample, 
using the basic data. First, the target sample is illuminated with the 
light from the Xe lamp 10a through the band-pass filter 22 to excite all 
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the fluorescent dyes in the target sample, and to acquire a fluorescence 
image of the target sample (step S206). in is step may be carried out 
continuously multiple times for nieasujiug a cjifci^^iC in cas-^s wiiv.e the 
concentr.r.ic.-ns of the fluorescent dyes VL;;.y witli v nie according lo an 
5 active state of the target sample, e.g., a case vhere the target sample is a 

living cell. The intensity of the light emitted firom tlie Xe lamp 10a is 
the same as that upon excitation of the reference samples for acquisition 
of the basic data. The multiband camera 30 receives the fluorescence 
image emitted j&om the sample 1, through the fluorescence microscope 

10 20 and converts it into image data. The fluorescence image is detected 
in each of the R, Q and B v^^avelength bands of the multiband camera 
30. Therefore, as shown m Fig. 3, the multiband camera 30 generates 
three image data 51-53 acquired in the three detection wavelength 
bands, for the target sample. The image data is fed to the computer 40. 

1 5 These image data will be sometimes called target data hereinafter. 

[0038] Next, the computer 40 calculates the concentrations of the 
fluorescent dyes pixel by pixel, using the target data acquired at step 
S206 and the basic data acquired at step S204 (step S208). The 
following will describe measurement of the concentrations of the 

20 fluorescent dyes at a site in the target sample, for easier understanding 
of this measurement calculation. Onc^ site ir: thz target stLiaplc 
corresponds to one pixel in the fluorescence image. It is assumed that 
the target sample contains two types of fluorescent dyes. In this case, 
two types of reference samples are prepared as well at step S202. 

25 [0039] The computer 40 determines concentrations cj and C2 of tlie first 
and second fluorescent dyes at a site in the target sample by an 
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operation represent^^d by fonrrula below. Units of tbe corrcntrations 
C] and C2 arc rhe aforernentjoned unit concentrations, i.e.. the 
concentrations cf ihe first and seconc ftucroFceni c\cl y.l ui:; first and 
second reference samples. Tl}':^efore, rji actual corj:^-'^n1/?t^on of tbe 
first fluorescent eye is a value obt^in'^':^ by ri'SiU;^^" 2 th^ ^^^^ 
concentration of the first fluorescent dye by Cj, a.:/ c:i actual 
concentration of the second fluorescent dye a value obtained by 
multiplying the unit concentration of the second fluorescent dye by Cj. 
The same also applies to the other embodiments described hereinafter. 
[Formula 7] 



tgt 



^tgt 



(1) 



Rf, Rf^ 
Gf, Gf, 
Bfj Bf, 



(2) 



In this formula, matrix J represents the basic data acquired at step S204. 
Rfi, Gfi, and Bfi in the first column of the matrix J represent the R, Q 
and B values acquired at step S204 with the first reference sample 
containing only the first fluorescent dye. Rfa, Gf2, and Bf2 in the 
second column of the matrix J represent the R, G, and B values acquired 
at step S204 with the second reference sample containing only the 
second fluorescent dye. Rtgt, Gtgt, and Btgt represent the R, Q and B 
values acquired at step S206 with the target S'iriTolc. :n Eq (]) 
represents a transpose of the matrix J. The above formula will be 
detailed later. 

[0040] The computer 40 executes the operation of Eq (1) for all the 
pixels to determine the concentrations of the first and second fluorescent 
dyes pixel by pixel. This obtains concentration distribution data 61 
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and 62 of the t^":. fl-.ore'^reiii dyes, ?3 sh^vr. T'v .2. 
[0041] Then tn?- C(>ii;puici- 40 generaes jrr!£f e da-r. for display ci' in- 
measuiem^nl i':;..v,;.' usiy.:, inpst. r.-^ r^cc.i.ivjucn c.-i-.'-il-uti'?-! 6} ■'■^■>^> 
62 (step £210\ ?-'.:s i:-?:- c:^^; --.^irr.-.- c---:,-;/. .m '^^j.- i:-;:--ns 
of the two i)uci-?r- :;t r'ves ci v'.- iT,\-- \ •z'^'-^-^l.- ""irc .-.-p d^-'- -i^ 

CT' ..... vX-... V- 

fed to the display cr^'^r? TIrou-.'' as showi- ri '".'g. 3, cn 
image 63 indicating the concentration distributions of the fluorescent 
dyes on the target sample is displayed along with a color bar 64 on the 
display device 42 (step S2 1 2). The computer 40 can also print out this 
concentration distribution image 63 and color bar 64 by means of 
printer 44. 

[0042] The foregoing Eqs (1) and (2) will be described below in detail. 
The intensity of fluorescence emitted from each fluorescent dye in the 
target sample increases in proportion to a concentration of the 
fluorescent dye. The addition theorem holds as to fluorescence 
emitted from multiple dyes. Therefore, R, Q and B values acquired at 
a certain pixel by the multiband camera 30 are expressed by the 
following equations. 
[Formula 8] 

=iAfj, +f,^ •c,)-r,-dZ (3.1) 

In these equations, fi and ii represent intensities of fluorescence emitted 
from the first and second fluorescent dyes in their unit concentration, 
and ci and c, concentrations of the first and second fluorescent dyes in 
the target sample. Rtgt, Gtgt, and B,g, represent the R, Q and B values of 



the multiband camera 30 at a site in the target sample. Parameters r. g, 
.and b represent the sensitivity characteristics of the rauhiband camera 
30 in the R. G and B Vv'*avelenAtb h^rrh. Subscriot k attached to the 
parameters i\ and ii and n g, and b inr^icates that these parameters ai*c 
5 functions of wavelengtli. 

[0043] fu'Cix is the intensit)' of fluorescence with a certain wavelength 
emitted from the first fluorescent dye in the target sample. Similarly, 
hk^ix is the intensity of fluorescence with a certain wavelength emitted 
from the second fluorescent dye in the target sample. Since the 

10 addition theorem holds, the total intensity of fluorescence with a certain 
wavelength is (fix'Cix + f2x"C2x)- The multiband camera 30 detects this 
fluorescence intensity in each of the R, Q and B wavelength bands. 
As represented by Bq (3.1), the R value acquired from the target sample 
is a value obtained by multiplying the total fluorescence intensity at 

15 each wavelength (fa-Cix + ^ix'^iy^ by a sensitivity characteristic r^ to the 

R wavelength band and integrating the product over the entire 
wavelength domain. Similarly, the G value or B value acquired from 
the target sample is a value obtained by multiplying the total 
fluorescence intensity (fu'Ca + ^ix^ri) by a sensitivity characteristic gx 

20 or bx to the G wavelength band or B wavelength band and integrating 
the product over the entire wavelength domain. As described i:bov\ 
the R, Q and B values of the fluorescence from the target sample are 
values obtained by multiplying the fluorescence intensity at each 
wavelength by the sensitivity of the camera 30 corresponding to the 

25 wavelength and integrating the product over the entire wavelength 

domain. An example of the sensitivity characteristics of the multiband 
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camera 30 is as shown in Fig. 9. This figure will be described later. 
[0044] Eqs. (3.])-(3.3) are rewritten into one matrix expression . as 
foiiov.L. 

[Form-j]:' i] 
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Eq (4) is fiirther rewritten as follows. 
[Formula 10] 
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^X ^2X 
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■dX 



(5) 



As represented by Eq (5), the R, Q and B values of fluorescence fi-om 
the target sample are calculated by multiplying the matrix J below by a 
concentration matrix of the fluorescent dyes. 
[Formula ll] 



\,f,^-rydX \,f,,'r,-dZ 
^xfi/Sx-d^ \zf2x'Sx-d^ 

\,fj^-b,-dX lj,f,ybj^-dX 



(6) 



[0045] The three components in the first colunm in the matrix J are the 
R, Q anr: jo values obtained by i .^iii... ;;.- -iie fluoresce, r.e intejisities in 
the unit concentration of the first fluorescent dye using the multiband 
camera 30. Hiese are equivalent to the aforementioned Rfi, Gfi, and 
Bfj obtained by the measurement of the first reference sample. 
Similarly, the three components in the second column in the matrix J 
are the R, G, and B values obtained by measuring the fluorescence 



- 27 - 



-o: 



intensities in the unit concentration of the secoro fluorescent dye using 
the multiband camera 30, and these are equivalent to the 
aforementioned Rf2, Gfj, and Bf: obtain^L oy ii)^ )nea5urcn^ent rTthe 
seconc' rcfnrv^-xe sample. Therefore, i!) t\ . " -/raer;^:. ir. the ir ;::ix 
5 J can be determined by measuring the fiuo^'escence emitted from these 

reference samples, using the multiband camera 30. Namely, the matrix 
J is equivalent to the basic data acquired at step S204. 
[0046] By modifying Eq (5), we obtain the aforementioned Eq (1). 
The computer 40 executes the aforementioned operation of Eq (1) using 
10 the basic data J, to calculate the concentrations Ci and C2 of the 
fluorescent dyes at each pixel. The concentrations of the fluorescent 
dyes contained at one site in the target sample are measured in this 
maimer. 

[0047] The above Eqs (1) and (2) are rewritten into more general forms 
15 as follows. 



[Formula 12] 















J 12 * 
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J 22 
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J km _ 





It is assumed herein that the target sample contains the first to mth 
(where m is an integer of 2 or more) fluorescem ^ r-.s aiid the muluLsnd 
20 camera has the first to kth (where k is an integer of 2 or more) different 

detection wavelength bands. Each of O] - Ok is the value of a pixel in 
the fluorescence image of the target sample taken in each of the first to 
kth detection wavelength bands using the multiband camera. J 
represents a kxm matrix, and component Jy in the ith row and jth 
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column (v h: -v i is any integer from 1 to k, and j any irtcr.ei from 1 to 
m) in J repre3^.;u:> i. measured intensit}' in the ith aeiecUon wavelength 
band orxh^ i Mwi.-.,i:c Lmiited from the jtli r: f .v:poc f ^c, 
[CQ-^aV? In tho pres^ it eir/bodiment, Jy represents to:^ vr -r:: of ix-e same 
pixel in the fiocrer.rcnce image of the jth reference sample taken in the 
ith detection ^vavelength band using the multiband camera as those for 
Oi - Ok. However, Jij does not always have to be the value of the same 
pixel as those for Oi - Ok. For example, if a reference sample emits 
fluorescence at a certain site only, it is possible to adopt a method of 
defining the value of an arbitrary pixel corresponding to the site as Jy 
and to use this Jy commonly in the measurement operation for all the 
pixels. In this case, the pixel of Jy does not always agree with the 
pixels for Oi - Ok. 

[0049] Next, how to express the measurement results will be described. 
There are a variety of expression methods of the measurement results, 
and the following will describe some specific examples. Fig. 4 shows 
an example of an expression method. This method is to express 
concentration distributions of two fluorescent dyes in a target sample, as 
monochrome images 71 and 72. In the images 71 and 72, the 
concentrations of the fluorescent dyes are expressed by luminances. A 
monochrome bar 7i is also displayed along "-'Tti. u.,; cc;.'- -.- . 
distribution in each image. As shown in Fig. 5, the concerjuaiion 
distribution of each fluorescent dye may be displayed using 
pseudocolors. Fig. 5 will be described later in more detail For 
clarifying the difference between the distributions of the two fluorescent 
dyes, it is also possible to adopt a method of calculating a ratio of the 



concentratio of fluorescent dye? and displaying a concentration 
ratio distribv^^'^^:' 3}:onochrome imsge or as an image using the 
pseudo""?] 

[0050] Arol' .^' m ethod of expressing the measurement results is tc plot 
tlie concer.trations of the fluorescent dyes at all the pixels in a color 3D 
space. Fig. c shav/s an example of an expression method using the 
color 3D space. In this example, the concentrations of the fluorescent 
dyes are plotted in the L*a*b* being a uniform color space. In Fig. 6 
the a* axis represents a color corresponding to the first fluorescent dye, 
and the b* axis a color corresponding to the second fluorescent dye. In 
addition, the L* axis represents brightness. A two-dimensional 
location in Fig. 6 represents a concentration ratio of the two fluorescent 
dyes. 

[0051] The following will describe the advantages of the present 
embodiment in comparison with the conventional technology. The 
conventional technology uses a combination of a filter for exfracting a 
wavelength component used in excitation of one fluorescent dye from 
output light of a light source with a filter for extracting a wavelength 
component corresponding to the fluorescent dye from fluorescence 
emitted from a sample, i.e., a filter set. This filter set is prepared for 
each fluorescent dye and is set in a fluorescence nicrc.scepe. 5cr 
example, filter sets to be prepared include a filter set for mainly 
observing blue fluorescence by ultraviolet excitation, a filter set for 
mainly observing green fluorescence by blue excitation, and a filter set 
for mainly observing red fluorescence by green excitation. While 
appropriately switching among these filter sets, fluorescence images 
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from the respective fluorescent dyes are i?':ir ^vith a monccliror-»e 
camera. Values of respective pixels are ha^'^-'^ as r^ata indicating the 
concenteiions Oithe iiuorescent dves. 

[0052] Hov/ever. if f voresrence spectra c\ plvrzVAy of fluorescerjt 
5 dyes overlap, fiuo' ..scence from these cy::- c:-.:not be perfectly 

separated by the b-nd-pass filter. Therefov.e. th? accuracy of the 
measurement is low where the overlap of the fluorescence spectra is 
large. In addition, the fluorescence images need to be acquired while 
repeatedly switching among the filter sets. For this reason, it is 

10 impossible to simultaneously measure the concentrations of a plurality 
of fluorescent dyes. This is a problem in cases where the target is a 
living sample. Furthermore, a slight change can occur in the optical 
system on the occasion of switching among the filter sets, and it could 
cause a difference in the accuracy of the measurement among the 

1 5 plurality of fluorescent dyes. 

[0053] In contrast, the present embodiment involves calculating the 
concentrations of the fluorescent dyes through the use of the calculation 
expression not affected by the overlap between the fluorescence spectra 
of the fluorescent dyes. Thus, the concentrations of the fluorescent 

20 dyes can be accurately determmed, regardless of the presence/absence 

of the overlap between the fluorescence s/ '.:/. This bccr.r.e 
clearer with reference to the examples described later. 
[0054] The present embodiment is arranged to perform the 
measurement by acquiring the fluorescence image of the target sample 

25 using the multiband camera 30 without switching among the filter sets. 

For this reason, the method of the present embodiment is able to 
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simulteneously- determine the concentrations of the multiple fluorescent 
dyes and, therefore^ is also suitably applicable to cases where the tai^get 
is a living S3ir;rle. Furtheirnore, iiie present en:*bodimcrit requires no 
change of the optical syctein during the measurement and is ibus able to 
determine the concenb*ations of the multiple fluorescent dyes with 
unifonn accuracy. Therefore, the method of the present embodiment 
obtains the concentrations of the fluorescent dyes with high reliabilit}^ 
[0055] Second Embodiment 

As shown in Fig. 1, a fluorescent dye measurement system 200 
of the present embodiment has a spectrometer 35 in addition to the 
configuration of the above-described measurement system 100. The 
spectrometer 35 is arranged to be able to receive a fluorescence image 
acquired with the fluorescence microscope 20. The fluorescence 
microscope 20 may have an optical element for feeding the fluorescence 
image to both of camera 30 and spectrometer 35, e.g., a half mirror. In 
another configuration, the spectrometer 35 may be set so as to be 
replaced with the camera 30. 

[0056] The present embodiment is different in the acquisition method 
of basic data at the aforementioned step S204 from the first 
embodiment. Namely, the present embodiment is arranged to acquire 
the basic data with the spectrometer 35, instead of ihc iiraltibc nd can:-rr£ 
30. In this case, the same advantages as in the first embodiment can be 
enjoyed. The other measurement procedure in the present embodiment 
is much the same as in the first embodiment. 

[0057] The basic data J acquired using the multiband camera 30 is the 
pixel values acquired by measuring the fluorescence from the reference 
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samples in each of the R, Q and B wavelength bands of fhe multiband 
cairera 30, as represented by the aforementioned Eq (2). As 
rcj^: v;3cirLed b)' Ti;.i cijorementioncd Eq (6). tb/.sc pixel v.:lui:s are tlic 
Vr^i;:f r obtained b}' r.Milupiyirig the fluoies'^-. v. iii.tensity ?r each 
wavelength of the fiuorescent dye in the unit concentration by the 
sensitivity characteristic of the camera corresponding to the wavelength 
and integrating the product over the entire wavelength domain. This 
integration can be approximately rewritten as follows. 
[Formula 13] 
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(9) 



In this expression, XI, 12,.,, In represents spectral wavelength bands 
obtained by dividing the entire wavelength domain by an arbitrary 
width, n is an integer of 2 or more and represents the number of 
spectral wavelength bands, r^t, gu, and bxt (t is an integer of 1-n) 
represent the R, Q and B sensitivity characteristics of the multiband 
camera 30 in the spectral wavelength band A.t. fixi and faxt represent the 
intensities in the spectral wavelength band At of the fluorescence, 
emitted jfrom the first and second fluorescent dyes in their unit 
concentration. It is assumed in Eq (9) that the R, G, and B sensitivity 
characteristics and the fluorescence intensities in the unit concentrations 
of the first and second fluorescent dyes have constant values in each 
spectral wavelength band. 
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[Cr.'Tj The fluorescence intensities in the un^t co-icentrctions of i;;>-^ 
nnr" cpcond fluorescent dyes in these spectral wavelength bands can i. 
measured using the spectrometer 35. Nansely, by ojlectiufj 
f/.-irerccnce emitted from the first and sec:n: reference sampb? 
tl-.e scectrometer 35, the fluorescence intensities fn.u aiid fi/.i, 

f2)2vf2?ji in the unit concentrations of the first and second fluorescent 
dyes in the spectral wavelength bands XI, X2,...Xn are acquired. These 
are spectral data represented by the second term on the right-hand side 
ofEq(9). 

[0059] In the present embodiment the computer 40 stores the spectral 
sensitivity characteristics of the multiband camera 30 corresponding to 
the first term on the right-hand side of Eq (9) in the storage device. 
When the computer 40 acquires the spectral data from each reference 
sample with the spectrometer 35, it executes the aforementioned 
operation of Eq (9) to calculate the matrix Js represented by Eq (9). 
[0060] This matrix Js and the matrix J being the basic data ideally 
agree with each other. In practice, however, coeiBBcients for calibration 
and coefficients for reduction of error in correlation are necessary for 
correlating the multiband camera 3 0 with the spectrometer 35. For this 
reason, an expression of a coefficient is necessary between the matrices 
I and Js. Therefore, the relation between J and j£. is expi? -- -. '. - 
follows. 
[Formula 14] 

J=ajs (10) 
In this equation a represents a constant for correction. The constant a 
is determined by detecting the white light from the Xe lamp 10a with 



each of thi multibind camerr 30 and speca-orsmr .-: t': .•- ;•, an XTD 
filter and calculating a ratio of light intensities me"?ired. 

As c.jscribsd above, e computer 4C r.-:.— r'.-r : . • ■yjcr?t:ous 
i^p-osentect by i£qs (9) rnT ('.' i: i ■..T-inp; tlir- > • ^ ■ ; /■ . - ■ - • ' [i: the 
spectrometer 35 end the sp.-ctru: sensitivity charcct^riip'o of the 
multiband camera 30 to calculate the basic dst? J. niis basic data J is 
used commonly in calculation of the fluorescent dye concentrations at 
all the pixels. In this case the concentrations of the fluorescent dyes 
can also be measured with good accuracy. 

[0062 J As represented by Eq (9) and Eq (10), the R, Q and B values of 
the multiband camera 30 can be calculated using the spectral data 
acquired with the spectrometer 35 and the sensitivity characteristic of 
the multiband camera 30. In more general description, the R, Q and B 
values of the multiband camera 30 and the R, Q and B values calculated 
using the spectral data of the spectrometer 35 can be mutually 
transformed using the constant a. Therefore, the concentrations of the 
fluorescent dyes can also be determined without the use of the camera 
30 by measuring the fluorescence from the target sample as well as 
those from the reference samples with the spectrometer 35 to acquire 
spectral data, calculating the R, G, and B values from the specfral data, 
and performing the aforementioned calculr. : n g:" ': \ It 
however, noted that the spectrometer 35 acquires tlie spec'aai data at 
only one. site in a sample at a time. For this reason, a distribution of 
the concenfrations of the fluorescent dyes can be more efficiently 
determined by taking the fluorescence image of the target sample using 
the imaging device such as the multiband camera 30. 



[0063] It is assumed in the above description that the types of t'v? 
fluorescent dyes in the target sample are preliminarily known. 
Hov^ever^ even in c^sos where the fii^oresceiii dyes ii. t';^e tsr,q.et r:.^^^^ 
are unknown, it is also pnsr":'b:e to specify tl^e iy; "r ^''ihc fl-i-: -yro^-' 
5 dyes and then to measure the concertratiojis thereof. In this csr^e, tlr.^ 

basic data is preliminarily acquired by measuring spectra of various 
known fluorescent dyes in advance or by acquiring publicly known 
spectra in advance. The basic data is stored in the storage device in the 
computer 40. The computer 40 performs the aforementioned 

10 calculation of Eq (1), using the spectral data acquired from a site in the 
target sample with the spectrometer and the basic data of one or more 
arbitrary fluorescent dye. Then the computer 40 calculates a spectruiri 
on the assumption that the target sample contains the fluorescent dye 
corresponding to the used basic data, using the calculated concentration 

15 values. The computer 40 compares this simulated spectrum with the 

spectrum of the target sample actually measured with the spectrometer, 
and determines whether a degree of Fitting betvveen them is not less 
than a predetermined threshold. The computer 40 searches for a 
fluorescent dye to provide a simulated spectrum adequately close to the 

20 actually measured spectrum in accordance with such a determination 

algorithm, to specify the fluorescent dye contained in the ta- get sampk. 
Once the fluorescent dye is specified, the concentrations of the 
fluorescent dye on all the pixels can be calculated by the method of the 
first embodiment. 

25 [0064] Even in the case v/here the known spectra are not prepared as 

the basic data, the concentration calculation can also be performed by 
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anrlyzinr^ the prin'^ipal components in a measuremer.t systcni of a target 
sample group and perfoiTn^jig the calculation using the principal 
' ccnpon.vit snrc'trr. of tlie i:.^.)]ts of the analysis a^", icCzrewzt spectra. 
is<5::r:iv vithout the basic c ' i*^ prr^j vcv^ in zfwr^Tc^ ih:. puipose of 
5 estimation as described above, it is also possible tc form an ideal 

reference spectrum considered to a principal component on a 
component basis out of a sample group and to perform the measurement 
calculation based thereon. For this reason, for example, it is also 
possible to quantify a component of fluorescence emitting substance 

10 that a sample itself has. In addition, it is also possible to perform a 
combinational calculation of this with the aforementioned one. 
[0065] Third Embodiment 

The present embodiment concerns the measurement where the 
target sample contains four or more types of fluorescent dyes. In cases 

15 where four or more types of fluorescent dyes are contained, the 

concentrations of the fluorescent dyes can be measured up to the same 
number as the number of detection wavelength bands if the number of 
detection wavelength bands of the multiband camera is increased 
according to the number of fluorescent dyes. In practice, a 4-band 

20 multicamera can be obtained by using the optical system described in 
"NHK STRL R&D" (No. 52, pp. 53-60, 1998). 1: i^ iiov/eA . difficuh 
to devise an optical system for implementing a 5 -band or 6-band 
camera. 

[0066] In the present embodiment, therefore, four or more types of 

25 fluorescent dyes are measured with a 3-band camera 30 as in the first 

and second embodiments. As described previously, the multiband 
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cpjaera 30 has the two sensitivity modes, the Low Light mode and the 
Hi??h Liplit mode. The Low Lieht mode is a mode in which the 
rtenderd senriiivity characteristic is set in each rletcciion waveicngih 
r-^nd- and t'le High Light mode a rnnde in which a sensiii^^ity 
characteristic a httle higher over all sensitivities than that in the Low 
Light mode is set in each detection wavelength band. In both of the 
Low Light mode and the High Light mode, portions of the detection 
wavelength bands overlap any adjacent bands. This multiband camera 
30 has two analog circuits having different gains in all the detection 
wavelength bands. A circuit with a low gain in the entire detection 
wavelength band is used in the High Light mode, and a circuit with a 
high gain in the entire detection wavelength band is used in the Low 
Light mode. 

[0067] Let Rtgt-i, Gtgt.i, and Btgt.i be R, G, and B values in the Low Light 

mode of the multiband camera 30, and Rtgt-h^ Gtgt-h, and Btgt-h be R, Q 
and B values in the High Light rnode, and then the following equation 
holds. 

[Formula 15] 
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In this equation, ri, gi, and bi represent sensitivity characteristics of the 
R, Q and B wavelength bands in the Low Light mode of the multiband 
camera 30, and rh, gh, and bh sensitivity characteristics of the R, Q and 
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B wavelength bands in the High Light mode of the niultiban.^ camera 
30. 

: u'.S''] Tbs 6-6 matrix of the iirst ^crm on ihi n^^ht-li'^nd z:dc hi (i ) ) 
i- ibe basic oaia in the presciA embodiment. ir^ly^ ■;b^IC^vl:'ig 
equation holds, 
[Formula 16] 



\j^fj-r,-dZ Ijif^-r^-dA 
\,frb,-dZ \,f,-b,.dZ 



\^fg-r,-dA. 
Ij^fg-g^-dZ 
\,fe'brdZ 

\,fe-b,-dZ 



(12) 



The six components in the first column of the matrix Ji represent the R, 
Q and B values of the multiband camera 30 obtained by measuring . 

10 intensities of the fluorescence in the unit concentration of the first 
fluorescent dye in the Low Light mode and in the High Light mode of 
the multiband camera 30. Similarly, the six components in each of the 
second to fifth columns of the matrix Ji represent the R, G, and B values 
of the multiband camera 30 obtained by measuring intensities of 

15 fluorescence in the unit concentration .of each of the second to sixth 

fluorescent dyes in the Low Light mode and in the High Light mode of 
the multiband camera 30. Therefore, all the components in the iiiairix 
Ji can be determined by measuring the fluorescence emitted from the 
first and second reference samples in both of the Low Light mode and 

20 the High Light mode of the multiband camera 30. 
[0069] Eq (11) can be rewritten as follows. 
[Formula 1 7] 
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Therefore, the concentrations of at most six types of fluorescent dyes 
can be calculated by measuring fluorescence from the reference samples 
to acquire the basic data Ji, thereafter detecting fluorescence from the 
target sample in both of the Low Light mode and the High Light mode 
of the multiband camera 30, and substituting obtained R, Q and B 
values intoEq (13). 

[0070] This embodiment is arranged to quantify the fluorescent dyes up 
to six types with the use of the 3 -band camera, and if a 4-band camera is 
used, the same technique allows us to quantify the fluorescent dyes up 
to eight types. More generally, it is possible to quantify the fluorescent 
dyes up to a number resulting from multiplication of the number of 
detection wavelength bands of the multiband camera by the number of 
sensitivity characteristics of the multiband camera. 
[0071] The foregoing Eqs (13) and (12) can be rewritten into more 
general forms as follows. 
[Formula 18] 
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It is assumed herein that the target sample contains the first to mth 
(where m is an integer of 2 or more) fluorescent dyes and that the 
multiband camera has the first to kth (where k is an integer of 2 or 
more) different detection wavelength bands and the first to qth (q is an 
integer of 2 or more) sensitivity modes for setting different sensitivity 
characteristics for the first to kth detection wavelength bands. The 
component matrices Pi-Pk represent kx 1 matrices. A component Pjv in 
the ith row (v is any integer firom 1 to q, and i any integer from 1 to k) in 
the matrix Pv represents the value of a pixel in the fluorescence image of 
the target sample taken in the ith detection wavelength band and in the 
vth sensitivity mode using the multiband camera. Ji is a (k q)xm 
matrix, and a component Li,j in the ith row in a component matrix Lyj 
(where j is any integer from 1 to m) m Jj represents the value of the 
same pixel as that for P^. in tlie fluorescence image of the jth reference 
sample taken in the ith detection wavelength band and in the vth 
sensitivity mode of the multiband camera. 
[0072] Fourth Embodiment 

The present embodiment concerns a measurement where the 
target sample contains four or more types of fluorescent dyes as the 
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tliird embo^riir.ent cid. In the third ernbodiiTi^nt, the t-^vo types of 
sensitivity modes of the multiband camera were prepared to enable the 
m^-';iirement of L.e rraorcscent dyes in to Iw^'ce the number of 
detection wavelengQi bands. In contrast to it, t ie ;;:£seiii embodhnent 
is arranged to excite a sample by plural types of excitation beams with 
different wavelength spectra, thereby enablmg the measurement of 
fluorescent dyes up to (the number of detection wavelength bands) x 
(the number of types of excitation beams). 

[0073] More specifically, the present embodiment uses the multicolor 
emission type LED 10b as a light source for exciting the sample. This 
LED 10b can emit plural types of output beams with different principal 
wavelengths. Every type of output beam has a wavelength spectrum 
that can excite all the fluorescent dyes contained in the target sample. 
The basic data is acquired based on the fluorescence emitted by 
illuminating each reference sample with each output beam to excite the 
fluorescent dye. The basic data may be acquired by taking 
fluorescence images using the multiband camera as in the first 
embodiment, or may be calculated usmg the spectral data of the 
spectrometer as in the second embodiment. 

[0074] Similarly, the target data is also acquired by illuminating the 
target sample with each output besm from the LED 10b to excite the 
fluorescent dyes and taking the fluorescence images with the camera 30. 
With different wavelength characteristics of excitation beams, a 
fluorescent dye also emits its fluorescence with different wavelength 
characteristics. Therefore, if the basic data and target data is acquired 
with switching among the principal wavelengths of the output beams 



froin The LED 10b. it becomes feasib-e to iri^asi're the fluorescent dyes 
up to a number resulting from multiplication of the number of detection 
wr.vcl.ri.fLii hvnds of the multiband czir^/rj : G by tiio nu: riti oi xyp^'s ql 
excit'fJon berais. For example, ai n*j::3i s::: types of fluorescent .dyes 
can be measured with two t>'pes of wavelength characteristics of 
excitation beams, and at most nine types of fluorescent dyes can be 
measured with three types of wavelength characteristics. 
[0075] In general, the computer 40 executes an operation represented 
by the following formula to calculate the concentrations of the 
respective fluorescent dyes. 
[Formula 19] 
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It is assumed herein that the target sample contains the first to mth 
(where m is an integer of 2 or more) fluorescent dyes and that the 
multiband camera has the first to kth (where k is an integer of 2 or 
more) different detection wavelength bands. The component matrices 
Qi - Qk are kxl matrices. Component Qiu in the ith row (where i is 
any integer from 1 to k) in the matrix Qu (where u is any integer from 1 
to r) represents the value of a pixel in a fluorescence image of the target 
sample taken in the ith detection wavelength band upon illuminating the 



x?.r^ei scmple with the rUi uxcitation beaiii. J: represents a (k-rj^m 
matrix, and component Tjuj in the ith row in a component matrix Tuj 
(v';:':re j is any interior f:o':n i to m) in Ji? rzpiC~r:Ks thr; value oi ihi 
sa:ne pixel as tb?', icr Q^u in a iiuorescenco ]mLgc of the jth refv^rence 
5 sample taken in the ith detection wavelength band of the multiband 

camera when the jth reference sample is illuminated with the uth 
excitation beam. 

[0076] The present embodiment uses the multicolor emission type LED 
10b, but it is also possible to use a plurality of light sources (LEDs or 

10 the like) for emitting beams of different wavelength spectra, instead 
thereof. In addition, the LED 10b may be replaced by a light source 
with variable output wavelengths. For example, it is possible to use a 
light source 10c for extracting a specific wavelength component from 
the output light of the Xe lamp by means of a monochrometer and 

15 emitting it, or a light source lOd for extracting a specific wavelength 

component from the output light of the Xe lamp by means of a 
wavelength filter and emitting it, 
[0077] Fifth Embodiment 

The present embodiment is different in the optical device used in 

20 the acquisition of the basic data and target data from the above- 
described embodiments. The above-described embodiments * are 
• arranged to acquire the basic data by means of the multiband camera or 
the spectrometer, whereas tiie present embodiment is arranged to 
acquire the basic data by means of a plurality of band-pass filters and a 

25 monochrome camera. The above-described embodiments are arranged 

to acquire the target data by means of the multiband camera, whereas 



the present eirtbodiment is arranged to acquivc the target ciif r. by means 
of a pluralit}' of band-pass filters and a monochroine camera. 
[;jCV<:j jci^. 7 is c hlcc^ oiagvnn. sijov/ing a cop^;^:....:Jcn Ox a 
fiuoresccut dye mr:5as*arein ::nl system of the pref .-^rr: embodiment. VMs 
5 measurement system 300 has the configuration resulting from 

replacement of the multiband camera 30 in the aforementioned 
measurement system 100 with a monochrome camera 32. The present 
embodiment uses a plurality of band-pass filters corresponding to a 
plurality of fluorescent dyes contained in a target sample, as band-pass 

10 filters 24. These band-pass filters have mutually dififerent transmitted 
wavelength bands. These transmitted wavelength bands are 
completely separated from each other, without overlap. The band-pass 
filters 24 can be, for example, interference filters. 
[0079] The present embodiment is arranged to extract fluorescent 

15 components of the respective fluorescent dyes from fluorescence of a 

target sample by means of the band-pass filters 24 and to detect them 
with the monochrome camera 32. This results in individually taking 
fluorescence images of the respective fluorescent dyes. The 
fluorescence intensities measured with the monochrome camera 32 are 

20 used in the same measurement calculation as in the above embodiment, 
thereby to calculate the concentrations of the respective fluorescciit 
dyes. In the present embodiment tlie fluorescence from the respective 
reference samples are also detected through the band-pass filters 24 with 
the monochrome camera 32 during acquisition of the basic data, 

25 [0080] For easier understanding of the measurement calculation, the 

following will describe the measurement on tlie assumption that a target 
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s-^mpje coTitains first rsA second fluorescent dyes and that ihc 
concentrations of the fluorescent dyes are measured at a site in the target 
E"".i'\r>., I'l this c?.sr?, jnft :-s in the abovz' erribodiror jst and seconi 
reference sr^'iples each cf n/!:/:!} i;idep.-i:::r.tly ccntai/.: one of the first 
and second fluorescent dyes, respectively, are prepared. Tlie computer 
40 executes an operation represented by the formula below to determine 
the concentrations of the fluorescent dyes at a site in the target sample. 
[Formula 20] 



0, 



(22) / = 



(23) 



2 A > lr2\ *^22, 

In the above formula, Oi represents the value of a pixel in a 
fluorescence image of the target sample taken through the filter 24 for 
the jSrst fluorescent dye, and O2 the value of the same pixel in a 
fluorescence image of the target sample taken through the filter 24 for 
the second fluorescent dye. Jn represents the value of the same pixel 
as those for Oi and O2 in the fluorescence image of the first reference 
sample taken through the filter 24 for the first fluorescent dye. 
represents the value of the same pixel as those for Oi and O2 in the 
fluorescence image of the first reference sample taken through the filter 
24 for the second fluorescent dye. J21 represents the value of the same 
pixel as those for Oi and O2 in the fluorescence image of tlie second 
reference sample taken through the filter 24 for the first fluorescent dye. 
J22 represents the value of the same pixel as those for Oi and O2 in the 
fluorescence image of the second reference sample taken through the 
filter 24 for the second fluorescent dye. 

[0081] The foregoing Eqs (22) and (23) can be generalized as follows. 
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It is assumed herein that the target sample contains the first to mth 
(where m is an integer of 2 or more) fluorescent dyes and that the first 
to mth band-pass filters are prepared corresponding thereto. Oj (where 
j is any integer fi-om 1 to m) represents tiie value of a certain pixel in a 
fluorescence image of the target sample taken through a filter for the jth 
fluorescent dye. Component Jy in the ith row and jth column (where i 
is any integer fi'om 1 to m) in the matrix J represents the value of the 
same pixel as that for Oj in a fluorescence image of the ith reference 
sample taken through a filter for the jth fluorescent dye. 
[0082] In the method of the present embodiment, the fluorescence fi-om 
the target sample are detected through the band-pass filters. For this 
reason, where fluorescence spectra of multiple fluorescent dyes largely 
overlap with each other, the measurement accuracy of the method of the 
present embodiment is inferior to those in the above embodiments. 
However, this method has higher measurement accuracy than tlie 
conventional technology to handle the fluorescence intensit}' detected 
through the band-pass filter, directly as a concentiaticn of a fluoresce- ..i 
dye. This is because the aiorementioned calculation formula is not 
affected by the presence/absence of an overlap between fluorescence 
spectra. The better me3F,urement accuracy than that of the 
conventional technology was verified by Inventor's experiment. 
[0083] Sixth Embodiment 



Tho prese?it embodiment is an applicr.tion of the presen: 
invention to measurement of physiological activity of celi. Namely, 
f-:pct sampl'i in the ii-xsent embcdiinent is a c:-.ii. : rrx^dSiuing 
the physiological aclivily of a ccii. functional nr^'^cu.os suc-i as 
5 receptors or enzymes in a cell are labeled with a fluorescent dye, and a 

concentration of the fluorescent dye is measured, thereby measuring an 
amount or distribution of the functional molecules. For simultaneously 
measuring multiple types of molecules existing in the same cell, those 
molecules are labeled with a plurality of fluorescent dyes having 

10 different excitation wavelengths and fluorescence wavelengths, and the 
molecules are discriminated according to their fluorescence colors. 
[0084] It can be contemplated in this case that the fluorescence from 
each fluorescent dye is extracted and detected with a band-pass filter to 
determine the fluorescence intensity. However, where the fluorescence 

15 spectra of these dyes largely overlap with each other, it is difficult to 

discriminate the molecules, because the filter fails to separate the 
fluorescence emitted fi-om the dyes, fi*om each other. 
[0085] In contrast to it, the present embodiment is arranged to measure 
the concentrations of the fluorescent dyes in the cell by use of the 

20 measurement system shown in Fig. 1 and in accordance with the 
procedure shovra in Fig. 2. The measurement system IZG ^1 ihe 
present embodiment is configured to determine the concentrations of the 
fluorescent dyes by the calculation using the basic data acquired in 
advance and the R, G, and B values acquired using the multiband 

25 camera 30. The basic data can be acquired by any one of the methods 

described about the above embodiments. Since there is no need for 
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detecting the ^J::oresrnj-:e from the ipultiple dyes by separating th'::r, 
the discrimination of molecules is easy. Therefore, the measurement 
sysren 100 rbe i r.^:?^Tl^ emboriime?'it is usefu- in measurome'r of f^r 
physic! -rg^:^! acdv.'y of cell. 

[0086] The following will describe particulars to be considered where 
the target sample is a cell, 

[0087] First, it is sometimes preferable to make a correction for the 
thickness of the cell. For measuring the concentrations of the 
fluorescent dyes by the method of the present invention, it is preferable 
that optical path lengths be equal in the sample during the measurement 
of fluorescence from the reference samples and the target sample. The 
reason is that different path lengths provide different fluorescence 
intensities even in samples of the same concentration. In the case of 
the target sample being a cell, the thickness of the cell containing the 
fluorescent dyes, i.e., the optical path length is at most about 10 [im. 
Where the reference samples are solutions of the fluorescent dyes, it is 
difiScult to accurately prepare the solution samples in the thickness of 
such order. Even if they can be prepared, there is a distribution of 
thicknesses according to the shape in one cell, and individual cells have 
different distributions. In comparison therewith, the optical path 
lengths are constant over the entire field of view in the solution samples. 
Therefore, the solution samples cannot be used as reference samples in 
measurement of a specific cell. 

[0088] If the microscope used is provided with a confocal optical 
system, the microscope acquires fluorescence images through a fixed 
path length and thus the solution samples can be used as reference 
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saroples. In the case of the microscope without the coniocaJ optical 
system, a potential correction method for the thickness of the cell is as 
fciicv/s. For example, in a case of measunn^ cc::ce.yuation 
distributions of flucrescent dyes Fl r-::^ F2 cont2.i\:^jl a celL ^MOihcr 
fluorescent dye F3 to uniformly stain the entire cell (Calcein, 
CellTracker, or the like) is added to tlae cell, in addition to tliese dyes. 
The cell stained with these three dyes is used as a target sample, dye 
solutions individually containing these three dyes are used as reference 
samples, and the measurement is carried out using them to perform the 
calculation by the method of the present invention, thereby to determine 
concentration distributions of the respective dyes including the 
component of thickness of the cell. Since the dye F3 among them is 
distributed in the uniform concentration over the entire cell, its acquired 
concentration distribution is proportional to the distribution of 
thicknesses of the cell. Concentration distributions corrected for the 
difference in the thickness of the cell can be acquired by using the 
concentrations at the respective pixels of the dye F3 as coefficients of 
the thickness of the cell at the respective pixels and dividing the 
calculated the concentrations of the respective pixels of Fl and F2 by 
the coefficients. 

[0089] In this case, it is dijBBcult to accurately determine the cpiical path 
lengths of the solution samples as the reference samples, and it is thus 
impossible to acquire absolute values of the concentrations of the 
fluorescent dyes. How^ever, this correction is useful in accurately 
grasping the distributions of the concentrations of the dyes in 1h.e cell. 
[0090] Second, in the case of the reference samples being cells, it is 



sometimes preferable to make a s}]?di: coLT-riion. Tbcrz r^r 
fluorescent dyes having a propeity that a dye alone emits a weak 
fluorescence o\:r enits a s'scvp fluorescence • v:]:tn conoled vvi-l: ? 
specific molr.cvl:. i.i a cell l.^aiiy ""yt^ ic. staining :r j.ic acicc, c.j^., 
5 DAPI, are of such a t}^pe. Concerning fluorescent proteins such as 

GFP, it is possible to make a fluorescent dye in a cell by introducing a 
gene into the cell, but it is difficult to prepare a dye sample outside the 
cell. For such dyes, solution samples cannot be used as the reference 
samples. In measurement of a fluorescent dye of this type, the basic 

10 data is acquired from a region emitting fluorescence in the cell stained 
with the fluorescent dye. An image of the cell is acquired, and an 
average of fluorescence intensities in a region selected from the cell 
image is used as a fluorescence intensity for a reference concentration. 
This value is assigned as the fluorescence intensity for the reference 

1 5 concentration to all the pixels. 

[0091] Illumination of excitation light in the fluorescence microscope is 
not uniform throughout the entire field of view. For this reason, when 
fluorescence from a sample in which a dye is uniformly distributed like 
a solution sample is obsen^ed with the fluorescence microscope, strong 

20 and weak portions of the fluorescence appear according to intensities of 
the excitation light in the image. This phenomenon is called shading. 
The values of the reference concentrations of the respective pixels must 
be those including information of this shading. When the solution 
samples are used as the reference samples, data obtained includes the 

25 information of shading. However, in the case where in use of a cell 

sample the basic data is acquired from a partial region thereof, the 
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infcrniE-.^ir.n of sBaJing is noi rA'?iid);e. 

[0092] In this case, in order to acquire the data of shading, a 
fluorescence image is accuiua iiom a sohjtion oi ihe ..covcsccPi dye to 
pcirait dw'Lciion o'i it^ ui'Ojesci^nce, usmg liie si^iuc.- oiillcr'. sj'siem 
5 (filter, dichroic mirror, lens, etc.) as that used in the measurement. 

Using this as a shading image^ the operation is performed pixel by pixel, 
whereby the information of shading can be given to the image of the 
reference sample (the image with the same fluorescence intensity given 
to all the pixels). A conceivable operation method for it is as follows. 
10 [0093] Irc = Is>^Ir/Is-max 

Irc: luminance of reference sample image with shading 
information 

Ir: luminance of original reference sample image 
Is: luminance of shading image 
15 Is-MAX- maximum luminance of shading image 

[0094] Another conceivable method is to correct the image of the target 
sample for shading and to directly use the image with the same 
fluorescence intensity to all the pixels as an image of each reference 
sample. In this case, a conceivable operation method for correcting the 
20 image of the target sample for shading is as follows. 

[0095] Itc = ItxIs.max/Is 

Ijc: luminance of target sample image corrected for shading 
It: luminance of original target sample image 
Is: luminance of shading image 
25 Is-MAX' maximum luminance of shading image 

[0096] Concentration distribution images of the fluorescent dyes 
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co?Tected for influence of shading cr.n ba rxqip'v^c by performin; t'*.''^ 
calculation represented by aforementioneci Eq (1) using the reference 
sample images or Lie tai-gei sanip'e irnaii^t ClA£jv.:u by the atove 
operation. In tliis cj s*:*^>: it i*^ "'l^^icu} ^ » . ^ :i::imir i/^ 

5 optical path length of the solution sample as each reference sample, it is 

infeasible to obtain the absolute values of the concentrations of the 
fluorescent dyes. However, this correction is useful in accurately 
grasping the distributions of the concentrations of the dyes in the cell. 
[0097] Seventh Embodiment 

10 The present embodiment is an application of the present 

invention to measurement of FRET (Fluorescence Resonance Energy 
Transfer). The FRET is a phenomenon in which an excitation energy 
given to a certain fluorescent molecule is transferred to another 
fluorescent molecule. The fluorescent molecule giving the excitation 

15 energy is called a donor, and the fluorescent molecule receiving the 

excitation energy, an acceptor. The donor and acceptor are generated 
by providing molecules with fluorescent dyes. 

[0098] With occurrence of the FRET, the fluorescence intensity of the 
donor decreases, while the fluorescence intensity of the acceptor 

20 increases. For this reason, the measurement of the FRET is often 
carried out as follows. A target sample is illuminated with a light 
beam of a wavelength to excite the donor, and fluorescence emitted 
from the target sample is detected. At this time, the fluorescence from 
the sample is spectroscopically separated into a wavelength region of 

25 the fluorescence of the donor and a wavelength region of the 

fluorescence of the acceptor with a band-pass filter. After this, the 
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fiuoresc'^^nco intensities of the accentor and cono/ rre sepsiately 
measured and a ratio of the fluorescence intensities of acceptor/donor is 
calcu^al't i ilie FRET can be r.nalyzed usinr i :i5: fluorescence 
intensity vc.l: 

5 [0099] In the nature of the phenomenon of the FRET, however, the 

fluorescence spectra of the donor and acceptor are not so apart from 
each other, but they often overlap in part. For this reason, the band- 
pass filter is unable to completely separate the fluorescence jfrom each 
other, which degrades the accuracy of the FRET measurement. 

10 [0100] The present invention can give a solution to this problem in the 

FRET measurement. The present embodiment is to measure the FRET 
. by use of the measurement system shown in Fig. 1 and in accordance 
with the procedure shown in Fig. 2. The first step is to prepare a donor 
reference sample containing only a fluorescent dye for the donor in a 

15 predetermined unit concentration and an acceptor reference sample 

containing only a fluorescent dye for the acceptor in a predetermined 
unit concentration (step S202), These reference samples are excited, 
intensities of fluorescence from the respective fluorescent dyes are 
measured in each of the R, Q and B wavelength bands, and the resultant 

20 measured, intensities are stored as basic data (step S204). The 

fluorescence intensities may be measured using the multiband camera 
30 or with the spectrometer 35. After this, the donor in the target 
sample is excited and a donor fluorescence and an acceptor fluorescence 
emitted from the target sample are detected using the multiband camera 

25 30 (step S206). In cases where the FRET amount in the target sample 

varies according to the active state of the target sample with time, e.g., 
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performed continuously multiple time?^ i : o rler to measure the 
vaiiation. Aucr xrn?., tha concentrations ot l:j >iu.-:i*eice:i; dye 11^3 

f .- '■ 1 r» • * . , 

to the ? foremen ti on ed Eq (1) (step 8208)3 and an image showing 
concentF/ition distributions of these dyes is displayed on the display 
device 42 (steps S2 1 0 and S2 1 2). 

[0101] The present embodiment uses a Cameleon solution containing 
Ca (14 |xg/ml) as a target sample. Cameleon contains a fluorescent 
dye CFP as a donor and a fluorescent dye YFP as an acceptor in its 
molecule. Cameleon also contains sites to bind to Ca^"^, between these 
fluorescent dyes. W^en Ca^"^ binds to Cameleon, its molecular 
structure changes to cause significant FRET from CFP to YFP according 
thereto. As a result, the fluorescence of CFP decreases, while the 
fluorescence of YFP increases. With increase in the Ca^"^ 
concentration, the fluorescence intensity ratio of YFP/CFP also 
increases according thereto. 

[0102] The present embodiment is arranged to measure the 
concentrations of CFP and YFP with stepwise change in the 
concentration of Ca in the target sample, and to multiply the 
concentrations by fluorescence intensities conc^iri/vJon vo 

calculate the fluorescence intensities of CFP and YFP. Then the 
fluorescence intensity ratio of YFP/CFP is calculated using these 
fluorescence intensities. 

[0103] Fig. 8 shows a relation between the concentrations of Ca^"^ in the 
target sample and the fluorescence intensity ratios calculated in the 



pre^^p" embo':''::vrnt. For comparison with the present eirbc^^imenl, 
Fig. 8 also shows the fluorescence intensity ratios obtained by the 
con'"p'^v?n:'] ;T:*ibod. In this melkod the fluoresr.en^p. fro tV^■ XTivprt 
Luuipic are delected using the multiband cGir.era 30, aiid ll-c y^^lio oio/Ii 
5 is calculated on the assumption that tlie G value of multiband camera 30 

is the fluorescence intensity of YFP and that the B value the 
fluorescence intensity of CFR In Fig. 8, rhomboids indicate the 
fluorescence intensity ratios obtained by the conventional method, 
squares the fluorescence intensity ratios based on the basic data 
10 acquired using the multiband camera 30, and triangles the fluorescence 

intensity ratios based on the basic data acquired with the spectrometer 
35. 

[0104] As shown in Fig. 8, the fluorescence intensity ratios acquired by 
the method of tiie present embodiment vary more significantly than the 

15 fluorescence intensity ratios acquired by the conventional method, 

according to the change in the Ca concentratiori. This is 
advantageous in detecting a fine change in the Ca concentration. The 
fluorescence of CFP is also detected in the G wavelength band of the 
camera 30 to measure the fluorescence of YFP in the conventional 

20 method. In the G wavelength band, therefore, the FRET increases the 
fluorescence intensity of YFP while decreases the fiuoiesoexice of CFP. 
It is considered that this curbs the increase of the G value of camera 30 
and thus curbs the change in the fluorescence intehsit}^ ratio according 
thereto. In contrast to it, since the method of the present embodiment 

25 is arranged to calculate the fluorescence intensities, using the 

calculation formula not affected by mixture of the fluorescence, the 



-56- 



fluorescence intenvity ratio varies with higher sensitivity according to 
the change in the Ca"'' concentration. 

[i;:iCL] In the present embodiment, thfi rnt:3s^irf"nient results are 
di:^ji:.yed by the cxpres::icn method shov/n in Fig. 5. In mis method 
5 the concentration information of the fluorescent dyes is displayed using 

the pseudocolors. Specifically, the concentration distributions of the 
first and second fluorescent dyes are displayed as images 81 and 82. 
In these images 81 and 82, the concentrations of the fluorescent dyes are 
indicated by luminances. Since in the FRET analysis the amount of 

10 FRET is generally evaluated by the intensity ratio of these two 

fluorescent dyes, i.e., the concentration ratio, a distribution of 
fluorescence intensity ratios calculated is indicated by pseudocolors in 
image 83. Furthermore, the fluorescence intensity ratios can be 
associated with Ca^"^ concentrations as in the graph of Fig. 8, whereby 

15 the values of the fluorescence intensity ratios can also be converted into 

the values of Ca^"^ concentrations. In image 84 a distribution of Ca^"^ 
concentrations is indicated using pseudocolors. A color bar 85 is also 
displayed in these images 81-84. 

[0106] The following will describe the advantage of the present 
20 embodiment in comparison with the conventional technology. A 

known method of determining the fluorescence intensity ratio iiiainiy by 
operation as in the present embodiment is the one disclosed in the ardcle 
by Gerald W. Gordon et al. "Quantitative Fluorescence Resonance 
Energy Transfer Measurements Using Fluorescence Microscopy" 
25 (Biophysical Journal, vol 74, pp2702-2713, May 1998). In this 

•method, three types of samples are prepared as in the present 



embodiment. This method uses three t>'pes of band-psss filters, i.e., a 
filter for excitirig the donor and measuring the fluorescence of the 
donor, a Liter ibr exciting the accept. oi and rucasuhiig lijc ii jorescence 
of liie acceptor, end a filter for exciiing liic donor £.k:; n*cL5u;uig iuc 
5 fluorescence of the acceptor. This method is to acquire nine 

measurements by combination of these samples with the filters and to 
determine the. value of FRET by mathematical operation. 
[0107] However, the method of the present embodiment is much 
simpler than the .method of Gordon et al. The reason is that the 

10 method of Gordon et al. involves nine fluorescence measurements, 
whereas the method of the present embodiment requires only three 
fluorescence measurements. When the measurement method of the 
present invention is applied to the FRET as described above, the 
fluorescence intensity ratio of acceptor/donor can be readily and quickly 

15 acquired. 

[0108] First Example 

The present invention will be further described below with some 
examples. The Inventor conducted the measurement of fluorescent 
dyes by use of the measurement system 100 shown in Fig. 1 and in 

20 accordance with the method of the first embodiment. The multiband 

camera 30 used was the 3-CCD color camera 0RCA-3CCD C7780 
available from Hamamatsu Photonics K.K. Fig. 9 shows spectral 
sensitivity characteristics of the camera 30. As described previously, 
the camera 30. has the two tj'pes of sensitivity modes, the Low Light 

25 mode and the High Light mode. In Fig. 9 solid lines indicate the 

sensitivity characteristics in the Low Light mode, and dashed lines the 
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c. :--\*v;tv \-hr:^cct?ris''cr v] the Hir^b Lioht n^cde. ]n the wosem 
example tlie R, G, and B vahies in the Low Light mode were used in the 

I', ''.'ii The liuorescent dy.: used were tluec Ijy.^G, Aicxt. riuor 350, 
5 Fura2, and Cascade Yellow. The Inventor mixed two of them in 

appropriate concentrations to prepare three types of solutions as target 
samples. These three types of dye solutions all have their absorption 
wavelengths in the same wavelength band (350-440 nm). When these 
dye solutions are illuminated with light in this wavelength band to 
10 excite the dyes, these solutions emit fluorescence having mutually 
different spectra. The band-pass filter 22 has a transmitted wavelength 
band equal to this wavelength band and extracts components in this 
wavelength band from the white light of Xe lamp 10a to generate 
excitation light. 

15 [0110] A specific measurement procedure wiir be described below. 

First, reference samples were prepared. A unit- concentration of each 
fluorescent dye was determined so as to obtain an appropriate 
fluorescence intensity according to the sensitivity of camera 30, and a 
solution independently containing each fluorescent dye in the unit 

20 concentration was prepared. Three types of solutions were obtained as 
reference samples in this manner. 

[0111] Next, the basic data was acquired using these reference samples. 
Specifically, each reference sample was excited and a fluorescence 
image generated from each reference sample was taken with the camera 
25 30. This image acquisition was conducted under the conditions of 

exposure of 30 msec and Gain = Low. The image data acquired in the 



R, G, r- ic B v.vvelenR'h bands o'^ t'-.e cE^nera 30 \v?s 5..~i_ j In. the 
storage device of the computer 40. The pixel values of the image data 

I'' ", b""' -i? used in the measu/eLieiit CLiCiiiaiioij. 
iGil2] Tbtn tv.'c. types of reference se.inpk; Vis-rc ra:.:' ' r.l an 

5 appropriate ratio to prepare a target sample, and the target sample is 

illuminated with the excitation light. A fluorescence image of the 
target sample was taken with the camera 30 to acquire image data. 
Pixel values of this image data are target data. The computer 40 
executed the operation represented by the aforementioned Eq (1) pixel 

10 by pixel, using the basic data and target data, to calculate concentration 
distributions of the two fluorescent dyes in the target sample. 
[0113] Second Example 

The Inventor also conducted acquisition of the basic data and 
target data with the use of the spectrometer 35, instead of the camera 30. 

15 The spectrometer 35 used was PMA-11 (c7473, BTGCD 200-950 nm) 

available jfrom Hamamatsu Photonics K.K. The measurement of 
fluorescence from reference samples with the spectrometer 35 was 
conducted in the light source mode and imder the conditions of s/n = 18, 
Gain = Middle, and wavelength interval = 1 nm. The computer 40 

20 performed a smoothing process of 5 pomts (5 nm) on the spectral data 
acquired with the spectrometer 35. 

[0114] For reference, the spectral data acquired from target samples is 
presented in Figs. 10 and 11. Fig. 10 shows the spectral data acquired 
from target samples in which the fluorescent dyes Alexa Fluor and 
25 Cascade Yellow are mixed at various ratios. The spacing between 

peak wavelengths of fluorescence emitted from these dyes is relatively 



-60- 



wioe, about 110 nm. 'Ei^. H shows the spectr?! d.v.a required froiri 
target samples in which the fluorescent dyes Fura2 and Cascade Yellow 
z\ ^ mixed at various tv'aos, Tiie spacing betv. e jn p: : ^ . ^.^•eJengths of 
iiutrrescence emitted ixorn ibese dyes is relatively najvovv, about 30 ma. 
5 As described above, the spectral data was the data obtained after the 

smoothing process. 

[0115] The computer 40 executed the operations represented by the 
aforementioned Eqs (9), (10), and (1), using the spectral data acquired 
from the reference samples and target samples, to calculate the 

10 concentrations of the dyes. The spectral data in all the spectral 

wavelength bands acquired from the reference samples were multiplied 
by the sensitivity characteristics shown in Fig. 9, the products were 
summed up, and the sum was multiplied by the coefiBcient a for 
correction indicated in Eq (10), thereby calculating the basic data J. 

15 Similarly, the spectral data in all the spectral wavelength bands acquired 

from each target sample were multiplied by the sensitivity 
characteristics shown in Fig, 9, the products were summed up, and the 
sum was multiplied by the coefiBcient a for correction, thereby 
calculating target data R^gt, Gtgt, and Btgt. This operation was conducted 

20 using the smoothed spectral data with the width of 5 nm in the range of 
300-780 nm. The spectrometer 35 can measure only a sice in each 
sample at a time. Numerical values calculated by the computer 40 
indicate dye concentrations at the measurement site. 
[0116] Third Example 

25 The Inventor also conducted measurement of the concentrations 

of fluorescent dyes according to the method of tlie fifth embodiment. 
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In this example, intensities of fluorescei^.ce eaiiiied fiom rcfe 
samples and target samples were measured through the band-pass filter. 
Three baud-pass Liters were useu acccclij^: lo h:x^ ilu'Xc^c jiic^' sy^zx^^ 
of three types o[ fiUorescent dyes. Tnz urst baid-pas: filler ^ac: i* ;- 
5 center wavelength of 440 rnn and the bandwidth of 21 nm. The second 

band-pass filter had the center wavelength of 5 1 0 nm and the bandwidth 
of 23 nm.^ The third band-pass filter had the center wavelength of 546 
nm and the bandwidth of 10 nm. 

[0117] Fluorescence through each band-pass filter was detected with a 
10 monochrome (B/W) camera. The monochrome camera used was the 
digital B/W camera ORCA-II available firom Hamamatsu Photonics 
K.K. The acquisition of fluorescence images was conducted under the 
conditions of exposure of 30 msec, Gain = Low, and binning 4*4. 
[0118] The computer 40 performed the operation represented by the 
15 aforementioned Eqs (22) and (23) using the pixel values of the 

fluorescence images taken with the monochrome camera. This 
resulted in calculating the concentrations of two fluorescent dyes in a 
target sample. 

[0119] For reference, fluorescence intensities were also measured with 
20 the same spectrometer as that used in the second example. 

Specifically, fluorescence intensities weie measured at iiiier . ais of 1 m/. 
with the spectrometer and the fluorescence intensities in ail the spectral 
wavelength bands were summed up to calculate the fluorescence 
intensities. 

25 [0120] Fig. 12 shows the spectral data measured through the band-pass 

filters firom target samples in which the fluorescent dyes Alexa Fluor 
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and Cascade Yellow are mixed at various ratios. Fig. 13 shows rh^ 
spectral data measured thiour!,): the band-pass filters fioni target samples 
in v^hich the f] joresceni qvll a U!a2 zud Casca.de Mnov/ rxrlxud 
vai'icus ratios. 

[0121] Comparative Example 

The Inventor also perfomied the measurement for comparison 
with the above examples in such a manner that fluorescence of each dye 
was extracted from fluorescence emitted from a target sample, using the 
band-pass filters, and the fluorescence was taken with the monochrome 
camera. The band-pass filters used were the same as in the third 
example. The monochrome camera used was the digital BAV camera 
ORCA-II available from Hamamatsu Photonics K,K. The acquisition 
of fluorescence images was conducted under the conditions of exposure 
of 30 msec. Gain = Low, and biiming 4*4. 

[0122] In this example, concentrations Ci and C2 of two fluorescent dyes 
in a target sample were calculated according to the following equations 
(conventional equations). 
[Formula 22] 

Sample SI / kij'yun SI (26.1) 
C2 - Sample S2 / kijyun S2 (26.2) 

In these equations, Sample Si and Sample S2 rep/esent interisiiies of 
fluorescence extracted from fluorescence of the target sample wdth the 
band-pass filters, and Kijyun SI and Kijyun S2 intensities of 
fluorescence emitted from reference samples. As apparent from these 
equations, the intensities of the fluorescence measured through the 
band-pass filters are handled as the concentrations of the respective 
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fjuorescent dyr.z jn the pn:^'rii ex?m])]e. 
[0123] Concentration Calculation Results 

First the iiieasniement resuhs oi /\]e::i. rluor and C^h'^-Cijoc 
Yellow witli a small overlap between their fluorescence spectra wi:l 
5 described with reference to Figs. 14 and 15, Fig. 14 shows the 

concentrations of Alexa Fluor and Cascade Yellow calculated in the first 
and second examples. Fig. 15 shows the concentrations of Alexa Fluor 
and Cascade Yellow calculated in the third example and in the 
comparative example. In these figures, the horizontal axis indicates 

10 the mixture ratios of dyes, and the vertical axis the concentrations of the 
dyes. The concentrations are indicated with the unit concentration of 
each dye being 1. The unit concentration of Alexa Fluor is 2 |iM 
(where micromole) and the unit concentration of Cascade Yellow 1 jiM. 
[0124] In Fig. 14 rhomboids indicate the concentrations of Alexa Fluor 

15 calculated in the first example, squares the concentrations of Alexa 

Fluor calculated in the second example, triangles the concentrations of 
Cascade Yellow calculated in the first example, and x the concentrations 
of Cascade Yellow calculated in the second example. In Fig. 15 
rhomboids indicate the concentrations of Alexa Fluor calculated in the 

20 third example, squares the concentrations of Alexa Fluor calculated in 

the comparative example, triangles the cou'^^riU^aiiouG oi C^iv:aw:. 
Yellow calculated in the third example, and x the concentrations of 
Cascade Yellow calculated in the comparative example. In tliese 
figures, a chain line indicates actual concentrations of Alexa Fluor in the 

25 target sample, and a dashed line actual concentrations of Cascade 

Yellow in the target sample. 



-64- 



[Q12:] It is seen fi:oi7i the co^r.i'arison between Tig. ]A rnd Tvj. 15 fr>^. 
there is little difference in the measurement accuracy of Alexa Fluor and 
C'^srcdc Ycilow with the: bclwern their cj^rer vvv,'eic'}gtbs 

being relatively wide, between the examples comparative 
5 example. This is because the overlap is small between the 

fluorescence spectra of these dyes. 

[0126] Next, the measurement results with Fura2 and Cascade Yellow 
with the overlap between their fluorescence spectra being large will be 
described with reference to Figs. 16 and 17. Fig. 16 shows the 

10 concentrations of Fura2 and Cascade Yellow calculated in the first and 
second examples. Fig. 17 shows the concentrations of Fura2 and 
Cascade Yellow calculated in the third example and in the comparative 
example. In these figures, the horizontal axis indicates the mixture 
ratios of the dyes, and the vertical axis the concentrations of the dyes. 

15 The concentrations are indicated with the unit concentration of each dye 

being 1. The unit concentration of Fura2 is 4 jjM, and the unit 
concentration of Cascade Yellow 0.8 \M. 

[0127] In Fig. 16 rhomboids indicate the concentrations of Fura2 
calculated in the first example, squares the concentrations of Fura2 

20 calculated in the second example, triangles the concentrations of 

Cascade Yellow calculated in the first example, and >^ the concentraacns 
of Cascade Yellow calculated in the second example. In Fig. 17 
rhomboids indicate the concentrations of Fura2 calculated in the third 
example, squares the concentrations of Fura2 calculated in the 

25 comparative example, triangles the concentrations of Cascade Yellov/ 

calculated in the third example, and x the concentrations of Cascade 
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Yellow calcul?ted in the comparative example. In these figurei-^ s 
chain line indicates actual concentrations of Fura2 in the target sample, 
and a dash?d )?ne ^r'v^^' concentrptinns of Osrade Yellow in the: t'^-get 
sample. 

[0128] It is seen from the comparison between Fig. 16 and Fig. 17 that 
the difference is large in the measurement accuracy of Fura2 and 
Cascade Yellow to emit fluorescence with the spacing between their 
center wavelengths being relatively narrow, between the examples and 
the comparative example. This is because the overlap is large between 
the fluorescence spectra of these dyes. Since the method of the 
comparative example is arranged to detect each fluorescence in a state 
in which the fluorescence of one dye is mixed in the fluorescence of the 
other dye, the accuracy of the measurement is significantly lowered. 
In contrast to it/ the methods of the examples are able to measure the 
concentrations of the dyes with high accuracy, witiiout being affected by 
the overlap between the fluorescence spectra. 

[0129] In the third example, as in the comparative example, the 
fluorescence from the sample are detected through the band-pass filter. 
It is seen from Fig. 17 that the measurement accuracy even in this case 
is superior to that in the comparative example. This arises from the 
difference between the calculation equations (22) and (23) used in the 
third example and the equations (26.1) and (26,2) used in the 
comparative example. As seen from the comparison between Fig. 16 
and Fig. 17, however, the measurement accuracy in the first and second 
examples to detect the fluorescence without interv^ention of the band- 
pass filter is much superior to that in the third example. A conceivable 
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rei^scn for i: is that in th? first and second example:) V '^ 
detection wavelength bands overlap and cover the entire wavelength 
oruio for evaluation, v/jiercas in the third example the adjai-wiic clotection 
v/avelength bands do not overlap, and data of only a partial wavelength 
band like a spot is handled, so as to fail to cover the entire evaluated 
wavelength band of the target sample, possibly with some lack of data. 
[0130] As apparent from Figs. 14 and 16, the fluorescence intensities 
can be measured with the camera, while achieving the measurement 
accuracy comparable to that in the case where the fluorescence 
intensities are measured with the spectrometer and where the calculation 
is conducted using the spectral data. As apparent from this, the 
technique in the first example, i.e., the measurement using the 
multiband camera is to determine the fluorescence intensity by 
multiplying spectral data in a wavelength region with a certain width to 
be measured, by a characteristic equivalent to a sensitivity function of 
the camera. Therefore, the measurement with the camera 
fimdamentally acquires the information equivalent to that where data is 
taken over the entire wavelength range as in the measurement with the 
spectrometer. For this reason, the measurement can be performed with 
the camera, with the accuracy equivalent to that in spectroscopy. 
[0131] The experiment results showed the dillerence between the 
measurement results with the camera and the measurement results witli 
the spectrometer. However, the Inventor and others clarified that the 
major factor for this difference was decrease in fluorescence intensity 
according to damage of the dyes due to light Namel)', the 
spectroscopic measurement took a too long measurement time and 



caused ? ion krr.e ledt^Lio:: in iLiji q. :i n'lv uic oyes. i.'.'s 
was found, the time icr spectral measurement was shortened, and this 
rasuhec iii apj,..oxLx;^\uJ ^.^-.cLu.etii u;:...^;-..: ruci-iareuioijt xw:3i>...... 

with the camera aiid Uie mcar.urement re::i:iis v. I.l: Ep^ctrometur. 
5 [0132] The accurac)^ of the measurement by the first and second 

examples will be confirmed below with reference to Figs. 18 to 20. 
Fig. 18 shows fluorescence spectra of a reference sample containing 
Fura2, a reference sample containing Cascade Yellow, and a target 
sample containing Fura2 and Cascade Yellow. The unit concentration 

10 of Fura2 is 4 \jM, and the unit concentration of Cascade Yellow 0.8 pM. 

In the target sample, Fura2 and Cascade Yellow are mixed at the ratio of 
0.6: 1 .4. The result of actual measurement of the target sample with the 
spectrometer is shown as a target spectrum in Fig. 18. 
[0133] The result of the measurement calculation in the camera method 

15 in the first example was Fura2:CaY= 0.571:1.4005, and the result of the 

measurement calculation in the spectrometer method in the second 
example Fura2:CaY = 0.528:1.434, Spectral intensities can be 
simulated by multiplying the calculated concentrations by the 
fluorescence spectra of the corresponding reference samples (hereinafter 

20 referred to as "reference spectra") and summing up the products. Fig. 

19 and Fig. 20 show simulation spectra calcuinted in this ma^^icr. 
[0134] In the spectrometer method the reference spectra and ihe target 
spectmm are actually measured. For this reason, the accuracy of the 
calculation itself can be confirmed by performing the simulation 

25 calculation using the reference spectra and comparing the resultant 
fluorescence spectrum with the tai*get spectrum. On the other hand, 
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w'.rn th: '"amera systerii is s*ncn}' cTirv'd.ircd. ihe reference rrer.tr? and 
target spectrum acquired in the camera method are delicately different 
fir:*'" t 'io=:e acquired in the fpecli(s:ic:ei ineiboc-. i or i-v':^ rc ^^sjij, it 
stands to reason that tliere is tlic difference between the liuoiescence 
spectram acquired by the simulation calculation in the camera metliod 
and the fluorescence spectrum acquired by the simulation calculation in 
the spectrometer method. Therefore, it is not always the case that 
amounts of deviation between the target spectrum actually measured 
and the fluorescence spectra acquired by the simulation results directly 
reflect the accuracies of the camera method and the spectrometer 
method. However, approximate accuracies can be checked and thus 
this technique was adopted. 

[0135] It is apparent from tiie comparison between Fig. 18 and Figs. 19 
and 20 that the fluorescence spectra calculated using the measurement 

results of the first and second examples are extremely close in shape to 
the actual fluorescence spectrum. It is therefore understood that the 
concentrations of the fluorescent dyes can be measured with excellent 
accuracy by the first and second examples. 
[0136] Eighth Embodiment 

Another embodiment of the present invention will be described 
below. Fig. 21 is a block diagram showing a coimgurarion of a 
fluorescent dye measurement system of the present embodiment. This 
measurement system 800 has the configuration obtained by replacing 
the multiband camera 30 in the measurement system 100 of the first 
embodiment with multiband camera 50a. In the present embodiment a 
logic circuit in the multiband camera 30a executes 'the operation of the 
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aforementioned Eq (7), instepd cf the p:trso-ial cnrr.fAiter 40. 
[0137] Fig. 22 shows various data associated with the measurement of 
the present embodhn^m. Just as in tiie. i.rsi ernboairiient, ihe 
multiband camera 30a has three detection wavelength bands, the R 
wavelength band, G wavelength band, and B wavelength band. Fig. 
22(a) shows the sensitivity characteristics of the multiband camera 30a. 
As shovra in this figure, portions of the detection wavelength bands 
overlap any adjacent bands. The multiband camera 30a includes three 
imaging devices corresponding to these detection wavelength bands, 
and a color separation prism for separating wavelength components of 
input light into the three detection wavelength bands and for feeding 
them to the corresponding imaging devices. 

[0138] Fig. 23 is a block diagram showing a signial processing circuit 
mounted on the multiband camera 30a. In addition to the 
aforementioned three imaging devices 101-103, the signal processmg 
circuit 31 includes amplifiers 111-113, A/D converters 121-123, a logic 
circuit 130 for measurement operation, timing regulator circuits 141- 
143, an interface circuit 150, a driving circuit 160, a timing generator 
circuit 162, and a control circuit 164. 

[0139] The imaging devices 101-103 are driven by the driving circuit 
160 to take fluorescence images of the target saniple in the rc.H:>ccuve R, 
Q and B wavelength bands and to generate three image signals. These 
image signals are amplified by the corresponding amplifiers 111-113, 
the amplified signals are digitized by the A/D converters 121-123, and 
the digital signals are fed to the logic circuit 130 for measurement 
operation. 



rpi^y. -'j^^ j^.^:^ circuit 130 executer ihe operation re::.r;\ c: -Led by inc 
aforementioned Eq (7) using these image signals, to cnlculate the 
co.y.ioxoons of the fluorescent dyes in irr-^ tra'g«--i l::..;,.^ h\. 
piXwl. i^.c^wilx (J^ in Bq (/) will b: ;c-:ir^:^ • 'ieinatcer as 

5 "reference data M." In the present embodiment this reference data M 

is fed from the computer 40 through the interface circuit 150 into the 
logic circuit 130. Instead thereof, however, the reference data M may 
be stored in a storage device provided in the multiband camera 30a. 
The logic circuit 130 assigns values according to the concentrations 
10 calculated for respective pixels, to the pixels to generate image signals 
indicating concentration distributions of the respective fluorescent dyes 
in the target sample. Each of these image signals is one of R, GL and B 
outputs from the multiband camera 30a. 

[0141] The timing generator circuit 162 supplies a clock signal to the 

15 A/D converters 121-123, to the logic circuit 130, to the timing regulator 

circuits 141-143, to the driving circuit 160, and to the control circuit 
164. The control circuit 164 receives a command from computer 40 
through the extemal interface circuit 150 and controls the operation of 
the logic circuit 130 in accordance with the command. For example, 

20 the control circuit 164 can also prohibit the logic circuit 130 from 
executing the operation of Eq (7) and let itic multib'.;:d cainera 30a 
output the image data itself acquired in the Q and B wavelength 
bands. The R, G, and B outputs are synchronized by the timing 
regulator circuits 141-143 to be fed from the extemal interface circuit 

25 150 to the computer 40. 

[0142] The computer 40 displays an image for display of the 
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meisuTeir.eiTj: usin? lue R, Q and B outputs from ihe multiD^vici 
camera 30a. on the aisplay device 42. For example, as shown in tig. 
^, iu;age 61 \ i./. ^ .v Iv, i\ aiid B uaiputs suj>^/im/,0::ed Xucy he 
c:?pi2.yc-'*' aloir*; ^ '-'w iii:; cclo' bar 64, or, as shcv.';: Fig. 4, the i., 'J, 
5 and B outputs may be displayed separately as independent images. 

The computer 40 c?n also make the printer 44 print these images. 
[0143] How to measure the concentrations of the fluorescent dyes in the 
target sample with the measurement system 800 will be described below 
with a specific example. Fig. 22(b) shows fluorescence spectra of the 

10 target sample and the first and second fluorescent dyes. This target 

sample is one obtained by staining Hela cells with two types of 
fluorescent dyes, DAPI and Mito Tracker Green. DAPI stains the 
nuclei of the cells, and Mito Tracker Green stains the mitochondria. 
The fluorescence spectrum of DAPI has a peak near 460 imi, and the 

1 5 fluorescence spectrum of Mito Tracker Green a peak near 515 nm. 

[0144] First the reference samples are prepared to acquire the basic 
data, in the same manner as in the first embodiment. Specifically, the 
Hela cells are stained with DAPI only, and with Mito Tracker Green 
only to prepare the first and second reference samples. Tnese 

20 reference samples are illuminated with the excitation light through the 
band-pass filter 22 having the transmitted wavelengui LaiK^ oL 405 ± 5 
nm. Fig. 22(c) siiows the fluorescence spectrum of me first reference 
sample and Fig. 22(d) the fluorescence spectrum of the second reference 
sample. 

25 [0145] The optical images of fluorescence emitted from the reference 

samples are taken using the multiband camera 30a through the band- 
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p?ss filter ?A having th?. transmitted vavclength bsnd of rol Ics? tl '^n 
.420 nm. The imaging devices 101-103 in the multiband camera 30a 
generate H.p^n of three images acqiii-:?: r\ tie 'hr^.e oetectio'^ ^ ■c-zz-'l^^r-^.h 
band, for eacli ic^ference sample. W^^t corivuter -rC icwUi a cc:y:\^::Z 
5 to the control circuit 164 to prohibit the logic circuit 130 from executing 

the operation of Eq (7) and to make the multiband camera 30a output 
these image data. The image data is fed to the computer 40 to be 
stored in the storage device in the computer 40. Similar measurement 
is carried out for all the reference samples and image data thereof is 
10 stored. 

[0146] In the reference samples of the present embodiment, the 

fluorescent dyes are scattered according to distributions of nuclei and 
mitochondria. For this reason, the value of an arbitrary pixel 
indicating a site emitting fluorescence in each reference sample is 

15 acquired from each fluorescence image of the reference sample to be 

used as basic data. Fig. 22(f) shows the R, Q and B values of a certain 
pixel, i.e., Rfi, Gfi, and Bfi, acquired from the first reference sample. 
In this example, Rfi = 19.980, Gfi = 121.939, and Bfi = 252.900. Fig. 
. 22(g) shows the R, Q and B values of a certain pixel i.e., Rfj, Gf25 and 

20 Bf2, acquired from the second reference sample. In this example, Rfa 

= 17.536, Gf2 = 164.062, and Bf2 = 8.926. Tliese values are ih^ basic 
data acquired from the reference samples, and are equal to the 
components in the matrix J represented by Eq (2). 
[0147] The computer 40 calculates the reference data M, i.e., the matrix 

25 (J^-J)-^;J\ using the matrix J acquired as described above. The 

reference data thus calculated is stored into the storage device in the 
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computer 40. As described hereinafter, this reference data M is used 
commonly in the operation of Eq (7) for all the pixels. The first stage 
of the measurement is comple.ted in this manner. 
(Gl-^^oj Next, the target Sdmpie is illuminated vvitli liie excitation light 
5 through the band-pass filter 22 onto and an image of fluorescence 

eniitted from the tai*get sample is taken using the multibaiid camera 30a. 
This results in feeding three image signals indicating fluorescence 
images taken in the R, Q and B wavelength bands, to the logic circuit 
130. Fig. 22(e) shows the R, Q and B values of a certain pixel, i.e., 

10 Rtgt, Gtgi, and Btgt in the fluorescence images of the target sample. In 
this example, R^gt = 24.605, Gtgt = 182.110, and Btgt = 192.145. 
[0149] The computer 40 feeds a command to the control circuit 164 to 
permit the logic circuit 130 to perform the operation of Eq (7) 
(practically, Eq (1)). The reference data M is also supplied from the 

15 computer 40 to the logic circuit 130. The logic circuit 130 executes 

the operation of Eq (1) for each pixel, using this reference data M, to 
calculate concentrations Ci and Ci of DAPI and Mitb Tracker Green. 
Fig. 22(h) shows the concentrations Ci and C2 calculated for pixels 
having the R, Q and B values shown in Fig. 22(e). In this case, Ci = 

20 0.74, and C2 = 0.56. Just as in the case of the above embodiments, the 

units of these concentration values are the concentratioxis of the 
fluorescent dyes in the corresponding reference samples. 
[0150] The logic circuit 130 assigns the values according to the 
concentrations cl and c2 calculated for each pixel, to the pixel to 

25 generate two image signals indicating the concentration distributions of 

DAPI and Mito Tracker Green in the target sample. These image 
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circuit 130.. Therefore^ the concentration distribiinO'i.s of DAPI and 

m^j]tib^-.io cn^nera 30?^ to the cciir^" v - V. T..?f'c iuiage sig:- -'^ may 
be transmitted to the computer 40 as separated from each other, or may 
be transmitted to the computer 40 after converted into a single 
composite signal. The computer 40 displays an image indicating the 
measurement results, using these image signals, on the display device 
42. 

[0151] Fig. 24 shows measurement result images in the present 
embodiment, in which (a) is an output image of the multiband camera 
30a, (b) a concentration distribution image of DAPI separated from the 
output image, and (c) a concentration distribution image of Mito 
Tracker Green separated from the output image. Original images of. 
these are color images, but the images herein are black-and-white 
images converted therefrom. Only nuclei are displayed in the image of 
DAPI, and only mitochondria in the image of Mito Tracker Green. As 
described above, the measurement system of the present embodiment is 
able to clearly separate and display two structures in the cells in real 
time. 

[0152] For comparison, the Inventor and others acr ui.t.: a ft av: r:3cence 
image of a target sample with the 3 -band camera no; perfbmiing the 
operation of the aforementioned Eq (1). Fig. 25 shows measurement 
result images of this comparative example, in which (a) is an output 
image of the 3 -band camera, and (b) and (c) fluorescence images in the 
B wavelength region and in the G wavelength region extracted fr'om the 



output image. These, are also originally color images, but they srri 
shown as black-and-white images converted therefrom. According to 
vV5'rbutions of the jluor?scej?ce spectra rt the ^yzs used, the 
iiucic5cei;ce of DAI'i is detecied in both of tl::: l G wa\ ci-::igtii 
5 regions, and most of the fluorescence of Mito Tracker Green is detected 

in the G region. For this reason, only the image of nuclei stained with 
DAPI appears in the image of the B wavelength region, but the image in 
the G wavelength region includes overlapping images of mitochondria 
stained with Mito Tracker Green and nuclei stained with DAPI. 

10 [0153] In the present embodiment, instead of the software operating on 

the personal computer 40, the hardware in the multiband camera 30a 
performs the measurement operation and generates the image signals 
indicating the concentration distributions, using the operation result. 
For this reason, the concentration distribution images can be displayed 

15 quicker than in the case where the concentration distribution images are 

generated by the software processing. As a result, a user can. confirm 
the results of the measurement immediately after the image acquisition 
of the target sample. 

[0154] The technique of the present embodiment can also be applied to 
20 any one of the aforementioned embodiments using the multiband 

camera. It is also possible to use the spectrometer 35 lor acquiring Un: 
basic data from the reference samples, as in the second embodiment. 
[0155] The present invention was described above in detail on the basis 
of the embodiments thereof. It is, however, noted that the present 
25 invention is by no means limited to the above embodiments. The 

present invention can be modified in various ways without departing 
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frcm the 5cof thereof. 

[01561 The above embodiments mainly used the imaging device having 
the R, Q rv7i 3 ^^•:^^^]en2.^h ban"): t::e r^^'^-ection wavHenftb h:^r,6z. 
However, th^ iniaging device to be used in the present iL\\.:..lvVt. n:ay 
5 have any other detection wavelength bands. 

[0157] The aforementioned Eq (1) is the equation W'here the matrix J is 
not regular. The reason why the matrix J is not regular is that the 
number of fluorescent dyes contained in the target sample is not 
coincident with the number of detection wavelength bands. Since the 
1 0 detection wavelength bands in the first embodiment are three, the matrix 
J will be regular if there are three types of fluorescent dyes in the target 
sample. In this case, Eq (1) is rewritten into a simple form as follows. 
[Formula 23] 















3. 







15 [0158] A 4-band camera having the sensitivity characteristics shown in 

Fig. 26 may be used instead of the 3 -band camera used in the above 
embodiments. This 4-band camera also has the tvvo sensitivity modes, 
the Low Light mode and the High Light mode. Therefore, as 
described in the third embodiment the fluorescen; dyes can be 

20 measured up to eight types. As shown in Fig. 26, tliis 4-band camera 

has the sensitivity in the near-infrared region. Therefore, this 4-band 
camera is useful in the measurement of the fluorescent dyes having the 
emission region in the near- infrared region. 

[0159] The multiband camera 30a used in the eighth embodiment has 
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the color separation prisrn and the plurality of inupinp. devices, but, 
instead thereof, the multiband camera may have one imaging device 
with a color mosaic filter cr tae iiy.e printed ihereoih 
lLdu3^^i iiiS Appiicabiiity 

[0160] The methods and measurement systems of the present invention 
are able to accurately measure the concentrations of a plurality of 
fluorescent dyes having overlapping fluorescence spectra. 
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